00000001:02000400:2.0F:1782239662.084489:0:2957:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg332-server.virtnet: executing set_hostid 00000001:02000400:2.0:1782239678.799529:0:3180:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg332-server.virtnet: executing load_modules_local 00000001:01000000:0.0F:1782239681.667153:0:3243:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 411 MB/s 00000001:01000000:3.0F:1782239681.918460:0:3243:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 271 MB/s 00000001:01000000:0.0:1782239682.170194:0:3243:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 2000 MB/s 00000020:02000000:2.0:1782239683.378704:0:3273:0:(class_obd.c:804:obdclass_init()) Lustre: Build Version: 2.17.54_83_g947bf2b 00000400:02000000:1.0F:1782239684.448117:0:3288:0:(api-ni.c:2752:lnet_startup_lndni()) Added LNI 192.168.203.132@tcp [8/256/0/180] 00008000:02000000:0.0:1782239689.524459:0:3438:0:(echo_client.c:2573:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:0.0:1782239752.160005:0:5244:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg332-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1782239762.460697:0:5771:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:0.0:1782239762.460706:0:5771:0:(obd_mount.c:917:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1782239762.461981:0:5771:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 000000009d7ed52b 00000080:02000400:0.0:1782239762.461997:0:5771:0:(super25.c:154:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:0.0:1782239762.469238:0:5771:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:0.0:1782239762.469269:0:5771:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1782239762.469602:0:5771:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (0000000029e7babb) 00000020:00000080:1.0:1782239762.469702:0:5771:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1782239762.525586:0:5771:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1782239762.526465:0:5771:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1782239762.615145:0:5771:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1782239762.615193:0:5771:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1782239762.615217:0:5771:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1782239762.615272:0:5771:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1782239762.615302:0:5771:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1782239762.615797:0:5771:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1782239762.615806:0:5771:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1782239762.615820:0:5771:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8c5345f1c1ec4961 00000020:01000004:2.0:1782239762.615830:0:5771:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1782239762.615836:0:5771:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1782239762.615841:0:5771:0:(tgt_mount.c:101:server_register_mount()) register mount 000000009d7ed52b from MGS 00000020:01000004:2.0:1782239762.615846:0:5771:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1782239762.615869:0:5771:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000e75ba397) 00000020:00000080:2.0:1782239762.615881:0:5771:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1782239762.615991:0:5771:0:(tgt_mount.c:153:server_get_mount()) get mount 000000009d7ed52b from MGS, refs=2 00080000:01000000:2.0:1782239762.615997:0:5771:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1782239762.616002:0:5771:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8c5345f1c1ec496f 00000100:00100000:2.0:1782239762.616123:0:5771:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1782239762.616273:0:5771:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1782239762.616280:0:5771:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1782239762.621717:0:5771:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1782239762.621737:0:5771:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1782239762.625543:0:5771:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782239762.629017:0:5771:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1782239762.629034:0:5771:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1782239762.635502:0:5771:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1782239762.635526:0:5771:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1782239762.644663:0:5771:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1782239762.644686:0:5771:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1782239762.650704:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782239762.650714:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782239762.650717:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782239762.651279:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782239762.651282:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782239762.651284:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782239762.653333:0:5771:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1782239762.655283:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1782239762.902838:0:5771:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 1771 MB/s 00000001:01000000:0.0:1782239763.154638:0:5771:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2490 MB/s 00000001:01000000:1.0:1782239763.406314:0:5771:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 436 MB/s 00000001:01000000:2.0:1782239763.656377:0:5771:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 735 MB/s 00080000:10000000:3.0:1782239763.673522:0:5771:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00010000:00010000:0.0:1782239763.678942:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1782239763.700799:0:5771:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1782239763.700814:0:5771:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1782239763.700817:0:5771:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1782239763.709565:0:5782:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1782239763.709653:0:5771:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1782239763.709736:0:5771:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:1.0:1782239763.710022:0:5771:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1782239763.710058:0:5771:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1782239763.710378:0:5771:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1782239763.710534:0:5771:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1782239763.710542:0:5771:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1782239763.711465:0:5771:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1782239763.711490:0:5771:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1782239763.713227:0:5771:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1782239763.713239:0:5771:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1782239763.714024:0:5771:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1782239763.714047:0:5771:0:(obd_mount.c:402:lustre_start_mgc()) Start MGC 'MGC192.168.203.132@tcp' 00000020:01000004:1.0:1782239763.714050:0:5771:0:(obd_mount.c:411:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1782239763.714102:0:5771:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGC192.168.203.132@tcp (typ=mgc) 00000020:00000080:1.0:1782239763.714115:0:5771:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.132@tcp (000000003ed43559) 00000020:00000080:1.0:1782239763.714131:0:5771:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1782239763.714205:0:5771:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000f13ffcf2@MGC192.168.203.132@tcp: add connection 192.168.203.132@tcp at head 00010000:00010000:1.0:1782239763.714372:0:5771:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.132@tcp-0 is initialized 00000040:01000000:1.0:1782239763.714380:0:5771:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.132@tcp ctxt 1 is initialized 00000100:00080000:0.0:1782239763.720086:0:5786:0:(pinger.c:468:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1782239763.720418:0:5787:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1782239763.720699:0:5771:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.132@tcp (uuid 7f2dda50-7c13-4c28-a10a-ae40ce7f74f7) 00000020:00000080:0.0:1782239763.720721:0:5771:0:(genops.c:1406:class_connect()) connect: client 7f2dda50-7c13-4c28-a10a-ae40ce7f74f7, cookie 0x8c5345f1c1ec497d 00000100:00080000:0.0:1782239763.720733:0:5771:0:(import.c:512:import_select_connection()) MGC192.168.203.132@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1782239763.720739:0:5771:0:(import.c:626:import_select_connection()) MGC192.168.203.132@tcp: import 00000000f13ffcf2 using connection 192.168.203.132@tcp/0@lo 00000100:00100000:0.0:1782239763.720838:0:5771:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000001ea44be6 x1868813758890112/t0(0) o250->MGC192.168.203.132@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1782239763.720860:0:5771:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import 7f2dda50-7c13-4c28-a10a-ae40ce7f74f7->MGS 00000020:01000004:0.0:1782239763.720877:0:5771:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1782239763.720883:0:5771:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1782239763.720902:0:5771:0:(genops.c:413:class_newdev()) Allocate new device MDS (0000000056521fd0) 00000020:00000080:0.0:1782239763.720915:0:5771:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1782239763.721338:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001ea44be6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3303:1868813758890112:0@lo:250: 00000100:00100000:3.0:1782239763.721392:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239763.721838:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758890112 00000100:00100000:1.0:1782239763.721845:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758890112 00000100:00100000:1.0:1782239763.721874:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782239763.721879:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fb4f4308 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3303:x1868813758890112:12345-0@lo:250: 00010000:00080000:1.0:1782239763.721901:0:5783:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 7f2dda50-7c13-4c28-a10a-ae40ce7f74f7@0@lo t0 exp 0000000000000000 cur 142 last 0 00000020:00000080:1.0:1782239763.721929:0:5783:0:(genops.c:1406:class_connect()) connect: client 7f2dda50-7c13-4c28-a10a-ae40ce7f74f7, cookie 0x8c5345f1c1ec498b 00000100:00080000:1.0:1782239763.722051:0:5783:0:(import.c:65:import_set_state_nolock()) 00000000ce9a4884 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782239763.722101:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fb4f4308 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+5:3303:x1868813758890112:12345-0@lo:250: Request processed in 220us (709us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239763.722109:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782239763.722147:0:3303:0:(client.c:3111:ptlrpc_free_committed()) MGC192.168.203.132@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1782239763.722155:0:3303:0:(import.c:1134:ptlrpc_connect_interpret()) MGC192.168.203.132@tcp: connect to target with instance 0 00000100:00080000:1.0:1782239763.722161:0:3303:0:(import.c:961:ptlrpc_connect_set_flags()) MGC192.168.203.132@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1782239763.723694:0:3303:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1782239763.723701:0:3303:0:(import.c:65:import_set_state_nolock()) 00000000f13ffcf2 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1782239763.723705:0:3303:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1782239763.723717:0:3303:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1782239763.723724:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001ea44be6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3303:1868813758890112:0@lo:250: 00000100:00100000:1.0:1782239763.770118:0:5771:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1782239763.770300:0:5771:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1782239763.770306:0:5771:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1782239763.777874:0:5771:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1782239763.777888:0:5771:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1782239763.779143:0:5771:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1782239763.779152:0:5771:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1782239763.786304:0:5771:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1782239763.786502:0:5771:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1782239763.786508:0:5771:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1782239763.787336:0:5771:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1782239763.787344:0:5771:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1782239763.927336:0:5771:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782239763.927549:0:5771:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1782239763.927556:0:5771:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1782239763.937137:0:5771:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1782239763.937155:0:5771:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1782239763.938396:0:5771:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1782239763.938830:0:5771:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1782239763.938837:0:5771:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1782239763.941005:0:5771:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1782239763.941025:0:5771:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1782239763.947485:0:5771:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1782239763.948262:0:5771:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1782239763.948271:0:5771:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1782239763.950912:0:5771:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1782239763.950929:0:5771:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1782239763.958356:0:5771:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1782239763.958550:0:5771:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1782239763.958557:0:5771:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1782239763.962324:0:5771:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1782239763.962340:0:5771:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1782239764.028146:0:5771:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782239764.028509:0:5771:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1782239764.028516:0:5771:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1782239764.033274:0:5771:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1782239764.033294:0:5771:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1782239764.035382:0:5771:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1782239764.035398:0:5771:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1782239764.052429:0:5771:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1782239764.052557:0:5771:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1782239764.052563:0:5771:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.132@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1782239764.052700:0:5771:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.132@tcp ctxt 0 is initialized 00000020:01000004:3.0:1782239764.052744:0:5771:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.132@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1782239764.052772:0:5771:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1782239764.052774:0:5771:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1782239764.052775:0:5771:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782239764.052777:0:5771:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782239764.052778:0:5771:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782239764.052779:0:5771:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782239764.052780:0:5771:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1782239764.052782:0:5771:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1782239764.052783:0:5771:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1782239764.052784:0:5771:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1782239764.052786:0:5771:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782239764.052787:0:5771:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1782239764.052794:0:5771:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1782239764.052796:0:5771:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1782239764.052797:0:5771:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1782239764.052798:0:5771:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782239764.052799:0:5771:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782239764.052799:0:5771:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782239764.052800:0:5771:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782239764.052801:0:5771:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1782239764.052801:0:5771:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1782239764.052802:0:5771:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1782239764.052803:0:5771:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1782239764.052804:0:5771:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782239764.052804:0:5771:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1782239764.052836:0:5771:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1782239764.052855:0:5771:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000008e53ddab pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5771:1868813758890240:0@lo:253: 00000100:00100000:3.0:1782239764.052922:0:5771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239764.052970:0:5771:0:(client.c:2701:ptlrpc_set_wait()) set 00000000153cf2b9 going to sleep for 11 seconds 00000100:00100000:1.0:1782239764.053035:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758890240 00000100:00100000:1.0:1782239764.053042:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758890240 00000100:00100000:1.0:1782239764.053078:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782239764.053084:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f504d1a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+5:5771:x1868813758890240:12345-0@lo:253: 20000000:01000000:1.0:1782239764.053122:0:5785:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1782239764.053125:0:5785:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1782239764.054008:0:5806:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1782239764.054070:0:5785:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:3.0:1782239764.054354:0:5785:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782239764.056049:0:5807:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:1.0:1782239764.056350:0:5785:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1782239764.056355:0:5785:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:1.0:1782239764.056361:0:5785:0:(mgs_llog.c:867:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:1.0:1782239764.056371:0:5785:0:(mgs_llog.c:3603:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:1.0:1782239764.056393:0:5785:0:(mgs_llog.c:3163:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:1.0:1782239764.056645:0:5785:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1782239764.056920:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:1.0:1782239764.056933:0:5785:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1782239764.056986:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:1.0:1782239764.057041:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:1.0:1782239764.057080:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:1.0:1782239764.057199:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:1.0:1782239764.057208:0:5785:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:1.0:1782239764.057254:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:1.0:1782239764.057261:0:5785:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:1.0:1782239764.057293:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:1.0:1782239764.057301:0:5785:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:1.0:1782239764.057331:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:1.0:1782239764.057379:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:1.0:1782239764.057409:0:5785:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1782239764.057414:0:5785:0:(mgs_llog.c:3163:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:1.0:1782239764.057426:0:5785:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1782239764.057645:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:1.0:1782239764.057656:0:5785:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1782239764.057689:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:1.0:1782239764.057723:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:1.0:1782239764.057808:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:1.0:1782239764.057821:0:5785:0:(mgs_llog.c:3120:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:1.0:1782239764.057896:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:1.0:1782239764.057906:0:5785:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1782239764.057951:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:1.0:1782239764.057989:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:1.0:1782239764.058021:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:1.0:1782239764.058032:0:5785:0:(mgs_llog.c:3085:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:1.0:1782239764.058114:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:1.0:1782239764.058131:0:5785:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:1.0:1782239764.058167:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:1.0:1782239764.058200:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:1.0:1782239764.058373:0:5785:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:1.0:1782239764.058427:0:5785:0:(mgs_llog.c:3300:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1782239764.058434:0:5785:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:1.0:1782239764.067127:0:5808:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:3.0:1782239764.070346:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:3.0:1782239764.070382:0:5785:0:(mgs_llog.c:3346:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.132@tcp for mdt 20000000:01000000:3.0:1782239764.070385:0:5785:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.203.132@tcp (null) (null) (null) 00000040:00080000:3.0:1782239764.070421:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:3.0:1782239764.070428:0:5785:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1782239764.070456:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:3.0:1782239764.070463:0:5785:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.132@tcp (null) (null) 00000040:00080000:3.0:1782239764.070519:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:3.0:1782239764.070530:0:5785:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1782239764.070562:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:3.0:1782239764.071123:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:3.0:1782239764.071283:0:5785:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:3.0:1782239764.071286:0:5785:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1782239764.071290:0:5785:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1782239764.071312:0:5785:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1782239764.071315:0:5785:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1782239764.071345:0:5785:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1782239764.071347:0:5785:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1782239764.071995:0:5809:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:1.0:1782239764.072281:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:1.0:1782239764.072324:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:1.0:1782239764.072356:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:1.0:1782239764.072367:0:5785:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1782239764.072369:0:5785:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1782239764.085225:0:5810:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:0.0:1782239764.085658:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:0.0:1782239764.085707:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:0.0:1782239764.085827:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:0.0:1782239764.085846:0:5785:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1782239764.085848:0:5785:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:0.0:1782239764.085855:0:5785:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1782239764.085857:0:5785:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1782239764.085862:0:5785:0:(mgs_llog.c:5063:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1782239764.085868:0:5785:0:(mgs_llog.c:1376:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1782239764.086688:0:5811:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:0.0:1782239764.086923:0:5785:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:0.0:1782239764.102956:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:0.0:1782239764.103012:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:0.0:1782239764.103090:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:0.0:1782239764.103111:0:5785:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1782239764.103132:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000dcaea82a/0x8c5345f1c1ec4992 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239764.103148:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000dcaea82a/0x8c5345f1c1ec4992 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239764.103158:0:5785:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000dcaea82a/0x8c5345f1c1ec4992 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239764.103313:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000dcaea82a/0x8c5345f1c1ec4992 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239764.103320:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000dcaea82a/0x8c5345f1c1ec4992 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239764.103343:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000dcaea82a/0x8c5345f1c1ec4992 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239764.103349:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000dcaea82a already unused, calling callback (00000000bc3818f0) 00010000:00010000:0.0:1782239764.103352:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000dcaea82a/0x8c5345f1c1ec4992 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239764.103359:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000dcaea82a/0x8c5345f1c1ec4992 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239764.103372:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000dcaea82a/0x8c5345f1c1ec4992 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239764.103378:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000dcaea82a/0x8c5345f1c1ec4992 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239764.103383:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000dcaea82a/0x8c5345f1c1ec4992 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1782239764.103400:0:5785:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1782239764.361367:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f504d1a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+5:5771:x1868813758890240:12345-0@lo:253: Request processed in 308277us (308439us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239764.361384:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782239764.361496:0:5771:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000008e53ddab pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5771:1868813758890240:0@lo:253: 10000000:01000000:2.0:1782239764.361510:0:5771:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1782239764.361514:0:5771:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1782239764.361516:0:5771:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1782239764.361517:0:5771:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782239764.361518:0:5771:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1782239764.361519:0:5771:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782239764.361521:0:5771:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782239764.361522:0:5771:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1782239764.361524:0:5771:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1782239764.361525:0:5771:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1782239764.361527:0:5771:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782239764.361541:0:5771:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1782239764.361562:0:5771:0:(tgt_mount.c:101:server_register_mount()) register mount 000000009d7ed52b from lustre-MDT0000 10000000:01000000:2.0:1782239764.361589:0:5771:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1782239764.361592:0:5771:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1782239764.361597:0:5771:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9bb5d1bd99c0 10000000:01000000:2.0:1782239764.361601:0:5771:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1782239764.361608:0:5771:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff9bb5d1bd99c0 from 1 10000000:01000000:2.0:1782239764.361610:0:5771:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1782239764.361658:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: 000000003287a4d8/0x8c5345f1c1ec4999 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239764.361668:0:5771:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: 000000003287a4d8/0x8c5345f1c1ec4999 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239764.361675:0:5771:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: 000000003287a4d8/0x8c5345f1c1ec4999 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239764.361693:0:5771:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000016fd9299 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5771:1868813758890368:0@lo:101: 00000100:00100000:2.0:1782239764.361728:0:5771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239764.361879:0:5771:0:(client.c:2701:ptlrpc_set_wait()) set 0000000021b71985 going to sleep for 11 seconds 00000100:00100000:0.0:1782239764.361981:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758890368 00000100:00100000:0.0:1782239764.361989:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758890368 00000100:00100000:0.0:1782239764.362034:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1782239764.362042:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b3a27d03 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+5:5771:x1868813758890368:12345-0@lo:101: 00010000:00010000:0.0:1782239764.362056:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782239764.362070:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000dcaea82a/0x8c5345f1c1ec49a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c5345f1c1ec4999 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239764.362090:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000dcaea82a/0x8c5345f1c1ec49a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4999 expref: 6 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239764.362105:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000dcaea82a/0x8c5345f1c1ec49a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4999 expref: 6 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239764.362112:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000dcaea82a, rc 0) 00000100:00100000:0.0:1782239764.362154:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b3a27d03 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+6:5771:x1868813758890368:12345-0@lo:101: Request processed in 113us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239764.362259:0:5771:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000016fd9299 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5771:1868813758890368:0@lo:101: 00010000:00010000:1.0:1782239764.362272:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: 000000003287a4d8/0x8c5345f1c1ec4999 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec49a0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239764.362280:0:5771:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: 000000003287a4d8/0x8c5345f1c1ec4999 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c5345f1c1ec49a0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239764.362344:0:5771:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000003bbd09d3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5771:1868813758890496:0@lo:501: 00000100:00100000:1.0:1782239764.362371:0:5771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239764.362387:0:5771:0:(client.c:2701:ptlrpc_set_wait()) set 000000009230be10 going to sleep for 11 seconds 00000100:00100000:1.0:1782239764.362403:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758890496 00000100:00100000:1.0:1782239764.362406:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758890496 00000100:00100000:0.0:1782239764.362577:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782239764.362736:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782239764.362777:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007934a4a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+6:5771:x1868813758890496:12345-0@lo:501: 00000100:00100000:1.0:1782239764.363018:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007934a4a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+6:5771:x1868813758890496:12345-0@lo:501: Request processed in 243us (646us total) trans 0 rc -2/-2 00000100:00100000:1.0:1782239764.363025:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1782239764.363093:0:5771:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000003bbd09d3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5771:1868813758890496:0@lo:501: 10000000:01000000:3.0:1782239764.363123:0:5771:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1782239764.363134:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: 000000003287a4d8/0x8c5345f1c1ec4999 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec49a0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239764.363141:0:5771:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: 000000003287a4d8/0x8c5345f1c1ec4999 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec49a0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782239764.363149:0:5771:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9bb5c8415000 10000000:01000000:3.0:1782239764.363155:0:5771:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1782239764.363159:0:5771:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9bb5c8415000 10000000:01000000:3.0:1782239764.363162:0:5771:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1782239764.363164:0:5771:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff9bb5c8415000 from 1 10000000:01000000:3.0:1782239764.363335:0:5771:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1782239764.363361:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: 00000000131640a6/0x8c5345f1c1ec49a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239764.363369:0:5771:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: 00000000131640a6/0x8c5345f1c1ec49a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239764.363376:0:5771:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: 00000000131640a6/0x8c5345f1c1ec49a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239764.363390:0:5771:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000031e92606 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5771:1868813758890624:0@lo:101: 00000100:00100000:3.0:1782239764.363422:0:5771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239764.363791:0:5771:0:(client.c:2701:ptlrpc_set_wait()) set 000000005d7ab812 going to sleep for 11 seconds 00000100:00100000:2.0:1782239764.363888:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758890624 00000100:00100000:2.0:1782239764.363894:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758890624 00000100:00100000:0.0:1782239764.363955:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1782239764.363963:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001990e874 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+6:5771:x1868813758890624:12345-0@lo:101: 00010000:00010000:0.0:1782239764.363973:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782239764.363984:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000471a865b/0x8c5345f1c1ec49ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c5345f1c1ec49a7 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239764.364000:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000471a865b/0x8c5345f1c1ec49ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c5345f1c1ec49a7 expref: 7 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239764.364008:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000471a865b/0x8c5345f1c1ec49ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c5345f1c1ec49a7 expref: 7 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239764.364016:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000471a865b, rc 0) 00000100:00100000:0.0:1782239764.364054:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001990e874 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+7:5771:x1868813758890624:12345-0@lo:101: Request processed in 93us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239764.364060:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1782239764.364265:0:5771:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000031e92606 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5771:1868813758890624:0@lo:101: 00010000:00010000:3.0:1782239764.364278:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: 00000000131640a6/0x8c5345f1c1ec49a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec49ae expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239764.364286:0:5771:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: 00000000131640a6/0x8c5345f1c1ec49a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c5345f1c1ec49ae expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782239764.364300:0:5771:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1782239764.364313:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: 00000000131640a6/0x8c5345f1c1ec49a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec49ae expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239764.364320:0:5771:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: 00000000131640a6/0x8c5345f1c1ec49a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec49ae expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782239764.364326:0:5771:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1782239764.364330:0:5771:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1782239764.364334:0:5771:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9bb5c8415000 10000000:01000000:3.0:1782239764.364337:0:5771:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1782239764.364339:0:5771:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1782239764.364341:0:5771:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1782239764.364355:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: 00000000397af263/0x8c5345f1c1ec49b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239764.364361:0:5771:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: 00000000397af263/0x8c5345f1c1ec49b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239764.364366:0:5771:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: 00000000397af263/0x8c5345f1c1ec49b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239764.364378:0:5771:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000031e92606 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5771:1868813758890752:0@lo:101: 00000100:00100000:3.0:1782239764.364414:0:5771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239764.364596:0:5771:0:(client.c:2701:ptlrpc_set_wait()) set 000000005d7ab812 going to sleep for 11 seconds 00000100:00100000:1.0:1782239764.364671:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758890752 00000100:00100000:1.0:1782239764.364676:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758890752 00000100:00100000:1.0:1782239764.364773:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1782239764.364780:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000087981b4b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+7:5771:x1868813758890752:12345-0@lo:101: 00010000:00010000:1.0:1782239764.364788:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782239764.364799:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005cb88442/0x8c5345f1c1ec49bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c5345f1c1ec49b5 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239764.364817:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005cb88442/0x8c5345f1c1ec49bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c5345f1c1ec49b5 expref: 8 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239764.364825:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005cb88442/0x8c5345f1c1ec49bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c5345f1c1ec49b5 expref: 8 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239764.364831:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005cb88442, rc 0) 00000100:00100000:1.0:1782239764.364860:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000087981b4b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+8:5771:x1868813758890752:12345-0@lo:101: Request processed in 82us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239764.364866:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1782239764.365003:0:5771:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000031e92606 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5771:1868813758890752:0@lo:101: 00010000:00010000:3.0:1782239764.365015:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: 00000000397af263/0x8c5345f1c1ec49b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec49bc expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239764.365023:0:5771:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: 00000000397af263/0x8c5345f1c1ec49b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c5345f1c1ec49bc expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239764.365069:0:5771:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000031e92606 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5771:1868813758890880:0@lo:501: 00000100:00100000:3.0:1782239764.365095:0:5771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239764.365118:0:5771:0:(client.c:2701:ptlrpc_set_wait()) set 000000005d7ab812 going to sleep for 11 seconds 00000100:00100000:2.0:1782239764.365184:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758890880 00000100:00100000:2.0:1782239764.365189:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758890880 00000100:00100000:2.0:1782239764.365208:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1782239764.365214:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000610d1dda pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+8:5771:x1868813758890880:12345-0@lo:501: 00000100:00100000:2.0:1782239764.365566:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000610d1dda pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+9:5771:x1868813758890880:12345-0@lo:501: Request processed in 350us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239764.365573:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1782239764.365679:0:5771:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000031e92606 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5771:1868813758890880:0@lo:501: 00000100:00100000:3.0:1782239764.365706:0:5771:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000031e92606 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5771:1868813758891008:0@lo:503: 00000100:00100000:3.0:1782239764.365886:0:5771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239764.366009:0:5771:0:(client.c:2701:ptlrpc_set_wait()) set 000000005d7ab812 going to sleep for 11 seconds 00000100:00100000:1.0:1782239764.366041:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758891008 00000100:00100000:1.0:1782239764.366047:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758891008 00000100:00100000:1.0:1782239764.366114:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1782239764.366121:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001ec17bfc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+9:5771:x1868813758891008:12345-0@lo:503: 00000100:00100000:1.0:1782239764.366286:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001ec17bfc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+9:5771:x1868813758891008:12345-0@lo:503: Request processed in 167us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239764.366293:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1782239764.366368:0:5771:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000031e92606 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5771:1868813758891008:0@lo:503: 00000100:00100000:3.0:1782239764.366781:0:5813:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000031e92606 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5813:1868813758891136:0@lo:502: 00000100:00100000:3.0:1782239764.366819:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239764.366988:0:5813:0:(client.c:2701:ptlrpc_set_wait()) set 000000005dbd92dc going to sleep for 11 seconds 00000100:00100000:2.0:1782239764.367059:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758891136 00000100:00100000:2.0:1782239764.367071:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758891136 00000100:00100000:2.0:1782239764.367095:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1782239764.367101:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008297c214 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+9:5813:x1868813758891136:12345-0@lo:502: 00000100:00100000:2.0:1782239764.367276:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008297c214 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+9:5813:x1868813758891136:12345-0@lo:502: Request processed in 175us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239764.367284:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1782239764.367372:0:5813:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000031e92606 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5813:1868813758891136:0@lo:502: 00000020:01000000:3.0:1782239764.367398:0:5813:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782239764.367409:0:5813:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782239764.367412:0:5813:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1782239764.367417:0:5813:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1782239764.367420:0:5813:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1782239764.367442:0:5813:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000a73280ad) 00000020:00000080:3.0:1782239764.367464:0:5813:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1782239764.367482:0:5813:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1782239764.367556:0:5813:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:3.0:1782239764.367562:0:5813:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8c5345f1c1ec49ca 00000020:00000080:3.0:1782239764.367875:0:5813:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1782239764.367879:0:5813:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782239764.367882:0:5813:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782239764.367884:0:5813:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1782239764.367886:0:5813:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782239764.367890:0:5813:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782239764.367891:0:5813:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1782239764.367894:0:5813:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1782239764.367899:0:5813:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (0000000032e130e8) 00000020:00000080:3.0:1782239764.367910:0:5813:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1782239764.367914:0:5813:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1782239764.367916:0:5813:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1782239764.367918:0:5813:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1782239764.367923:0:5813:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1782239764.367964:0:5813:0:(tgt_mount.c:153:server_get_mount()) get mount 000000009d7ed52b from lustre-MDT0000, refs=3 00000020:00000080:3.0:1782239764.367975:0:5813:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000cddc899d) 00000020:00000080:3.0:1782239764.367983:0:5813:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1782239764.368052:0:5813:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1782239764.368057:0:5813:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8c5345f1c1ec49df 00000020:00000080:3.0:1782239764.368149:0:5813:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1782239764.368155:0:5813:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1782239764.368159:0:5813:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x8c5345f1c1ec49e6 00080000:01000000:3.0:1782239764.368163:0:5813:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:3.0:1782239764.368166:0:5813:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8c5345f1c1ec49ed 00080000:10000000:3.0:1782239764.368533:0:5813:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:3.0:1782239764.368716:0:5813:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1782239764.374355:0:5813:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1782239764.451281:0:5813:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1782239764.451609:0:5813:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1782239764.455589:0:5813:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1782239764.456036:0:5813:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1782239764.485328:0:5813:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000007e5d5706) 00000020:00000080:1.0:1782239764.485349:0:5813:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1782239764.485418:0:5813:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:1.0:1782239764.485424:0:5813:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8c5345f1c1ec49fb 00000020:00000080:3.0:1782239764.487100:0:5813:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1782239764.489933:0:5813:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:0.0:1782239764.568590:0:5813:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1782239764.609591:0:5813:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1782239764.637106:0:5813:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:1.0:1782239764.673877:0:5813:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00010000:00010000:1.0:1782239764.708951:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:1.0:1782239764.723690:0:5813:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:1.0:1782239764.760902:0:5813:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x8c5345f1c1ec4a02 00000020:00000080:0.0:1782239764.762986:0:5813:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1782239764.762999:0:5813:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782239764.763004:0:5813:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782239764.763011:0:5813:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1782239764.763014:0:5813:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782239764.763017:0:5813:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782239764.763019:0:5813:0:(obd_config.c:1561:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:0.0:1782239764.763021:0:5813:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1782239764.763023:0:5813:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1782239764.763026:0:5813:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782239764.763027:0:5813:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782239764.763028:0:5813:0:(obd_config.c:1561:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:0.0:1782239764.763030:0:5813:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782239764.763034:0:5813:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782239764.763035:0:5813:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1782239764.763038:0:5813:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1782239764.763078:0:5813:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:0.0:1782239764.763126:0:5813:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000005f84a23e pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5813:1868813758891264:0@lo:502: 00000100:00100000:0.0:1782239764.763196:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239764.763248:0:5813:0:(client.c:2701:ptlrpc_set_wait()) set 000000008e14d7cc going to sleep for 11 seconds 00000100:00100000:3.0:1782239764.763523:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758891264 00000100:00100000:3.0:1782239764.763530:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758891264 00000100:00100000:3.0:1782239764.763575:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1782239764.763582:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007a920c3a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+9:5813:x1868813758891264:12345-0@lo:502: 00000100:00100000:3.0:1782239764.766263:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007a920c3a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+9:5813:x1868813758891264:12345-0@lo:502: Request processed in 2676us (3062us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239764.766278:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1782239764.767915:0:5813:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000005f84a23e pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5813:1868813758891264:0@lo:502: 00000020:01000000:0.0:1782239764.767957:0:5813:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782239764.767965:0:5813:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782239764.767968:0:5813:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:0.0:1782239764.767972:0:5813:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:3.0:1782239764.768308:0:5771:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:3.0:1782239764.768328:0:5771:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1782239764.768341:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: 00000000397af263/0x8c5345f1c1ec49b5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec49bc expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239764.768352:0:5771:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: 00000000397af263/0x8c5345f1c1ec49b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec49bc expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782239764.768359:0:5771:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9bb5c8415000 from 1 10000000:01000000:3.0:1782239764.768361:0:5771:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1782239764.768398:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: 0000000094bc7ff1/0x8c5345f1c1ec4a09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239764.768405:0:5771:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: 0000000094bc7ff1/0x8c5345f1c1ec4a09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239764.768414:0:5771:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: 0000000094bc7ff1/0x8c5345f1c1ec4a09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239764.768433:0:5771:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000031e92606 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5771:1868813758891392:0@lo:101: 00000100:00100000:3.0:1782239764.768509:0:5771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239764.768552:0:5771:0:(client.c:2701:ptlrpc_set_wait()) set 00000000725fdb97 going to sleep for 11 seconds 00000100:00100000:0.0:1782239764.768956:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758891392 00000100:00100000:0.0:1782239764.768963:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758891392 00000100:00100000:0.0:1782239764.769006:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1782239764.769013:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006b20274a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+9:5771:x1868813758891392:12345-0@lo:101: 00010000:00010000:0.0:1782239764.769025:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782239764.769036:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000fb62dd40/0x8c5345f1c1ec4a10 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c5345f1c1ec4a09 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239764.769055:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fb62dd40/0x8c5345f1c1ec4a10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4a09 expref: 10 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239764.769070:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000fb62dd40/0x8c5345f1c1ec4a10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4a09 expref: 10 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239764.769078:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000fb62dd40, rc 0) 00000100:00100000:0.0:1782239764.769119:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006b20274a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+10:5771:x1868813758891392:12345-0@lo:101: Request processed in 107us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239764.769125:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1782239764.769522:0:5771:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000031e92606 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5771:1868813758891392:0@lo:101: 00010000:00010000:3.0:1782239764.769537:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: 0000000094bc7ff1/0x8c5345f1c1ec4a09 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4a10 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239764.769545:0:5771:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: 0000000094bc7ff1/0x8c5345f1c1ec4a09 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c5345f1c1ec4a10 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239764.770109:0:5771:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000031e92606 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5771:1868813758891520:0@lo:256: 00000100:00100000:3.0:1782239764.770155:0:5771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239764.770189:0:5771:0:(client.c:2701:ptlrpc_set_wait()) set 00000000725fdb97 going to sleep for 11 seconds 00000100:00100000:0.0:1782239764.770244:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758891520 00000100:00100000:0.0:1782239764.770249:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758891520 00000100:00100000:0.0:1782239764.770281:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1782239764.770288:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008ddf8ba5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+10:5771:x1868813758891520:12345-0@lo:256: 20000000:01000000:0.0:1782239764.770303:0:5783:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1782239764.770309:0:5783:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1782239764.770370:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008ddf8ba5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+10:5771:x1868813758891520:12345-0@lo:256: Request processed in 83us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239764.770376:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1782239764.770681:0:5771:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000031e92606 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5771:1868813758891520:0@lo:256: 10000000:01000000:3.0:1782239764.771284:0:5771:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1782239764.771301:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: 0000000094bc7ff1/0x8c5345f1c1ec4a09 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4a10 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239764.771310:0:5771:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: 0000000094bc7ff1/0x8c5345f1c1ec4a09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4a10 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782239764.771317:0:5771:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9bb5c8415000 from 1 10000000:01000000:3.0:1782239764.771320:0:5771:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1782239764.771346:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: 000000008bd7ee43/0x8c5345f1c1ec4a17 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239764.771352:0:5771:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: 000000008bd7ee43/0x8c5345f1c1ec4a17 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239764.771359:0:5771:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: 000000008bd7ee43/0x8c5345f1c1ec4a17 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239764.771382:0:5771:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000031e92606 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5771:1868813758891648:0@lo:101: 00000100:00100000:3.0:1782239764.771421:0:5771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239764.771444:0:5771:0:(client.c:2701:ptlrpc_set_wait()) set 00000000725fdb97 going to sleep for 11 seconds 00000100:00100000:1.0:1782239764.771660:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758891648 00000100:00100000:1.0:1782239764.771666:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758891648 00000100:00100000:1.0:1782239764.771694:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1782239764.771700:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000abcbf6b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+10:5771:x1868813758891648:12345-0@lo:101: 00010000:00010000:1.0:1782239764.771710:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782239764.771722:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c55c88c2/0x8c5345f1c1ec4a1e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c5345f1c1ec4a17 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239764.771766:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c55c88c2/0x8c5345f1c1ec4a1e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4a17 expref: 11 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239764.771775:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c55c88c2/0x8c5345f1c1ec4a1e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4a17 expref: 11 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239764.771783:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c55c88c2, rc 0) 00000100:00100000:1.0:1782239764.771813:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000abcbf6b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+11:5771:x1868813758891648:12345-0@lo:101: Request processed in 114us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239764.771819:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1782239764.772072:0:5771:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000031e92606 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5771:1868813758891648:0@lo:101: 00010000:00010000:3.0:1782239764.772085:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: 000000008bd7ee43/0x8c5345f1c1ec4a17 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4a1e expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239764.772092:0:5771:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: 000000008bd7ee43/0x8c5345f1c1ec4a17 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c5345f1c1ec4a1e expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239764.772136:0:5771:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000031e92606 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5771:1868813758891776:0@lo:501: 00000100:00100000:3.0:1782239764.772161:0:5771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239764.772187:0:5771:0:(client.c:2701:ptlrpc_set_wait()) set 00000000725fdb97 going to sleep for 11 seconds 00000100:00100000:1.0:1782239764.772240:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758891776 00000100:00100000:1.0:1782239764.772245:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758891776 00000100:00100000:1.0:1782239764.772273:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1782239764.772278:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009a49baf8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+11:5771:x1868813758891776:12345-0@lo:501: 00000100:00100000:1.0:1782239764.773096:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009a49baf8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+11:5771:x1868813758891776:12345-0@lo:501: Request processed in 815us (932us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239764.773104:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1782239764.773678:0:5771:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000031e92606 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5771:1868813758891776:0@lo:501: 00000100:00100000:3.0:1782239764.773716:0:5771:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000031e92606 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5771:1868813758891904:0@lo:503: 00000100:00100000:3.0:1782239764.777848:0:5771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239764.777902:0:5771:0:(client.c:2701:ptlrpc_set_wait()) set 00000000725fdb97 going to sleep for 11 seconds 00000100:00100000:0.0:1782239764.779364:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758891904 00000100:00100000:0.0:1782239764.779377:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758891904 00000100:00100000:0.0:1782239764.779427:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1782239764.779435:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008f565e7b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+11:5771:x1868813758891904:12345-0@lo:503: 00000040:00080000:0.0:1782239764.779502:0:5785:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1782239764.779576:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008f565e7b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+11:5771:x1868813758891904:12345-0@lo:503: Request processed in 142us (1736us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239764.779584:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1782239764.779686:0:5771:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000031e92606 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5771:1868813758891904:0@lo:503: 00000040:00080000:1.0:1782239764.781297:0:5817:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:3.0:1782239764.781697:0:5771:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1782239764.781717:0:5771:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1782239764.782363:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: 000000008bd7ee43/0x8c5345f1c1ec4a17 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4a1e expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239764.782376:0:5771:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: 000000008bd7ee43/0x8c5345f1c1ec4a17 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4a1e expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782239764.782673:0:5771:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1782239764.782676:0:5771:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9bb5c8415000 10000000:01000000:1.0:1782239764.782679:0:5771:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9bb5c8415000 10000000:01000000:1.0:1782239764.782684:0:5771:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1782239764.782690:0:5771:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9bb5c8415000 from 1 10000000:01000000:1.0:1782239764.782692:0:5771:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1782239764.782726:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: 00000000d0cae50d/0x8c5345f1c1ec4a25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239764.782735:0:5771:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: 00000000d0cae50d/0x8c5345f1c1ec4a25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239764.782904:0:5771:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: 00000000d0cae50d/0x8c5345f1c1ec4a25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239764.782925:0:5771:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000004be26c4f pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5771:1868813758892032:0@lo:101: 00000100:00100000:1.0:1782239764.782988:0:5771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239764.783108:0:5771:0:(client.c:2701:ptlrpc_set_wait()) set 0000000031f3896c going to sleep for 11 seconds 00000100:00100000:0.0:1782239764.783172:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758892032 00000100:00100000:0.0:1782239764.783179:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758892032 00000100:00100000:0.0:1782239764.783229:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1782239764.783245:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ee353f5f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+11:5771:x1868813758892032:12345-0@lo:101: 00010000:00010000:0.0:1782239764.783259:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782239764.783270:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008a7afe43/0x8c5345f1c1ec4a2c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c5345f1c1ec4a25 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239764.783294:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008a7afe43/0x8c5345f1c1ec4a2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4a25 expref: 12 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239764.783303:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008a7afe43/0x8c5345f1c1ec4a2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4a25 expref: 12 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239764.783310:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008a7afe43, rc 0) 00000100:00100000:0.0:1782239764.783400:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ee353f5f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+12:5771:x1868813758892032:12345-0@lo:101: Request processed in 156us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239764.783407:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1782239764.783521:0:5771:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000004be26c4f pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5771:1868813758892032:0@lo:101: 00010000:00010000:3.0:1782239764.783537:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: 00000000d0cae50d/0x8c5345f1c1ec4a25 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4a2c expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239764.783544:0:5771:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: 00000000d0cae50d/0x8c5345f1c1ec4a25 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c5345f1c1ec4a2c expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239764.783647:0:5771:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000031e92606 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5771:1868813758892160:0@lo:501: 00000100:00100000:3.0:1782239764.783676:0:5771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239764.783728:0:5771:0:(client.c:2701:ptlrpc_set_wait()) set 00000000725fdb97 going to sleep for 11 seconds 00000100:00100000:0.0:1782239764.783902:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758892160 00000100:00100000:0.0:1782239764.783907:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758892160 00000100:00100000:0.0:1782239764.783974:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1782239764.783981:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007303d28d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+12:5771:x1868813758892160:12345-0@lo:501: 00000100:00100000:0.0:1782239764.784311:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007303d28d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+12:5771:x1868813758892160:12345-0@lo:501: Request processed in 329us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239764.784317:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1782239764.784383:0:5771:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000031e92606 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5771:1868813758892160:0@lo:501: 00000100:00100000:3.0:1782239764.784413:0:5771:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000031e92606 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5771:1868813758892288:0@lo:503: 00000100:00100000:3.0:1782239764.784451:0:5771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239764.784530:0:5771:0:(client.c:2701:ptlrpc_set_wait()) set 00000000725fdb97 going to sleep for 11 seconds 00000100:00100000:2.0:1782239764.784603:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758892288 00000100:00100000:2.0:1782239764.784609:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758892288 00000100:00100000:2.0:1782239764.784633:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1782239764.784639:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000006ef6176 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+12:5771:x1868813758892288:12345-0@lo:503: 00000100:00100000:2.0:1782239764.784962:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000006ef6176 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+12:5771:x1868813758892288:12345-0@lo:503: Request processed in 323us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239764.784969:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1782239764.785103:0:5771:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000031e92606 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5771:1868813758892288:0@lo:503: 00000100:00100000:3.0:1782239764.785708:0:5818:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000031e92606 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5818:1868813758892416:0@lo:502: 00000100:00100000:3.0:1782239764.785782:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239764.785848:0:5818:0:(client.c:2701:ptlrpc_set_wait()) set 00000000f334e149 going to sleep for 11 seconds 00000100:00100000:1.0:1782239764.786011:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758892416 00000100:00100000:1.0:1782239764.786017:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758892416 00000100:00100000:2.0:1782239764.786066:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1782239764.786074:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000019630e03 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+12:5818:x1868813758892416:12345-0@lo:502: 00000100:00100000:2.0:1782239764.786350:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000019630e03 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+12:5818:x1868813758892416:12345-0@lo:502: Request processed in 277us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239764.786357:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1782239764.786503:0:5818:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000031e92606 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5818:1868813758892416:0@lo:502: 00000020:01000004:3.0:1782239764.786563:0:5818:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1782239764.786642:0:5818:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000006fcb8edd) 00000020:00000080:3.0:1782239764.786661:0:5818:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1782239764.787052:0:5818:0:(tgt_mount.c:153:server_get_mount()) get mount 000000009d7ed52b from lustre-MDT0000, refs=4 00000020:01000004:3.0:1782239764.787057:0:5818:0:(tgt_mount.c:187:server_put_mount()) put mount 000000009d7ed52b from lustre-MDT0000, refs=4 00000020:01000004:3.0:1782239764.787068:0:5818:0:(obd_mount.c:701:lustre_put_lsi()) put 000000009d7ed52b 4 00010000:00080000:3.0:1782239764.787096:0:5818:0:(ldlm_lib.c:102:import_set_conn()) imp 000000008849475f@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.132@tcp at head 00010000:00010000:3.0:1782239764.789737:0:5818:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:0.0:1782239764.793084:0:5818:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1782239764.793127:0:5818:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1782239764.793139:0:5818:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x8c5345f1c1ec4a3a 00000100:00080000:0.0:1782239764.793150:0:5818:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1782239764.793156:0:5818:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000008849475f using connection 192.168.203.132@tcp/0@lo 00000100:00100000:0.0:1782239764.793190:0:5818:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000005f84a23e x1868813758892544/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1782239764.793228:0:5818:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1782239764.793451:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000005f84a23e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1868813758892544:0@lo:38: 00000100:00100000:3.0:1782239764.793530:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239764.793648:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758892544 00000100:00100000:2.0:1782239764.793655:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758892544 00000100:00100000:2.0:1782239764.793691:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782239764.793697:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000031e92606 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3303:x1868813758892544:12345-0@lo:38: 00000100:00100000:2.0:1782239764.793780:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000031e92606 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3303:x1868813758892544:12345-0@lo:38: Request processed in 82us (250us total) trans 0 rc -11/-11 00000100:00100000:2.0:1782239764.793796:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782239764.793943:0:3303:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1782239764.793950:0:3303:0:(import.c:65:import_set_state_nolock()) 000000008849475f lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1782239764.793954:0:3303:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1782239764.793957:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000005f84a23e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1868813758892544:0@lo:38: 00000100:00100000:0.0:1782239764.794160:0:5818:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000008cb00720 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5818:1868813758892672:0@lo:502: 00000100:00100000:0.0:1782239764.794207:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239764.794226:0:5818:0:(client.c:2701:ptlrpc_set_wait()) set 0000000005386ca7 going to sleep for 11 seconds 00000100:00100000:2.0:1782239764.794278:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758892672 00000100:00100000:2.0:1782239764.794283:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758892672 00000100:00100000:2.0:1782239764.794321:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1782239764.794328:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000754160ff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+12:5818:x1868813758892672:12345-0@lo:502: 00000100:00100000:2.0:1782239764.794554:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000754160ff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+12:5818:x1868813758892672:12345-0@lo:502: Request processed in 226us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239764.794561:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1782239764.794603:0:5818:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000008cb00720 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5818:1868813758892672:0@lo:502: 00000040:00080000:2.0:1782239764.794628:0:5818:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:2.0:1782239764.794679:0:5771:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1782239764.794694:0:5771:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1782239764.794707:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: 00000000d0cae50d/0x8c5345f1c1ec4a25 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4a2c expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239764.794716:0:5771:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: 00000000d0cae50d/0x8c5345f1c1ec4a25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4a2c expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1782239764.794791:0:5771:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1782239764.794793:0:5771:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1782239764.794794:0:5771:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782239764.794795:0:5771:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782239764.794796:0:5771:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782239764.794798:0:5771:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782239764.794799:0:5771:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1782239764.794800:0:5771:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1782239764.794802:0:5771:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1782239764.794803:0:5771:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1782239764.794805:0:5771:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782239764.794806:0:5771:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1782239764.794809:0:5771:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1782239764.794816:0:5771:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1782239764.794817:0:5771:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1782239764.794818:0:5771:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782239764.794818:0:5771:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782239764.794819:0:5771:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782239764.794820:0:5771:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782239764.794821:0:5771:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1782239764.794822:0:5771:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1782239764.794822:0:5771:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1782239764.794823:0:5771:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1782239764.794824:0:5771:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782239764.794825:0:5771:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1782239764.794838:0:5771:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1782239764.794846:0:5771:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000a34092c4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5771:1868813758892800:0@lo:253: 00000100:00100000:2.0:1782239764.794880:0:5771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239764.794891:0:5771:0:(client.c:2701:ptlrpc_set_wait()) set 0000000006fea891 going to sleep for 11 seconds 00000100:00100000:0.0:1782239764.796189:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758892800 00000100:00100000:0.0:1782239764.796199:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758892800 00000100:00100000:0.0:1782239764.796249:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1782239764.796256:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ceab3a8a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+12:5771:x1868813758892800:12345-0@lo:253: 20000000:01000000:0.0:1782239764.796300:0:5785:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1782239764.796314:0:5785:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1782239764.832924:0:5785:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1782239764.832935:0:5785:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1782239764.833264:0:5806:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1782239764.833269:0:5806:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1782239764.833287:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000004bf6b0a4/0x8c5345f1c1ec4a41 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239764.833305:0:5806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000fb62dd40/0x8c5345f1c1ec4a10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4a09 expref: 12 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239764.833324:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000004bf6b0a4/0x8c5345f1c1ec4a41 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239764.833361:0:5806:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000fb62dd40/0x8c5345f1c1ec4a10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8c5345f1c1ec4a09 expref: 12 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239764.833374:0:5806:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000fb62dd40/0x8c5345f1c1ec4a10 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8c5345f1c1ec4a09 expref: 12 pid: 5785 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239764.833389:0:5806:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000002d96221d pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5806:1868813758892928:0@lo:104: 00000100:00100000:1.0:1782239764.833453:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239764.833508:0:5806:0:(client.c:2701:ptlrpc_set_wait()) set 000000002e70dab9 going to sleep for 11 seconds 00000100:00100000:0.0:1782239764.834007:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758892928 00000100:00100000:0.0:1782239764.834015:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758892928 00000100:00100000:0.0:1782239764.834480:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782239764.834491:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005b9229d2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+3:5806:x1868813758892928:12345-0@lo:104: 00010000:00010000:0.0:1782239764.834504:0:5773:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.132@tcp lock: 0000000094bc7ff1/0x8c5345f1c1ec4a09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c5345f1c1ec4a10 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239764.834580:0:5773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782239764.834585:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005b9229d2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+3:5806:x1868813758892928:12345-0@lo:104: Request processed in 98us (1133us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239764.834593:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782239764.834877:0:5806:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000002d96221d pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5806:1868813758892928:0@lo:104: 00010000:00010000:2.0:1782239764.834898:0:5806:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000004bf6b0a4/0x8c5345f1c1ec4a41 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239764.838892:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782239764.838904:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.132@tcp lock: 0000000094bc7ff1/0x8c5345f1c1ec4a09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c5345f1c1ec4a10 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239764.838915:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000094bc7ff1 already unused, calling callback (00000000731bd9ff) 10000000:00010000:1.0:1782239764.838917:0:5779:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.132@tcp lock: 0000000094bc7ff1/0x8c5345f1c1ec4a09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8c5345f1c1ec4a10 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239764.838926:0:5779:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.132@tcp lock: 0000000094bc7ff1/0x8c5345f1c1ec4a09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8c5345f1c1ec4a10 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782239764.838932:0:5779:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.132@tcp lock: 0000000094bc7ff1/0x8c5345f1c1ec4a09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8c5345f1c1ec4a10 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782239764.838937:0:5779:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1782239764.838984:0:5779:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.132@tcp lock: 0000000094bc7ff1/0x8c5345f1c1ec4a09 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c5345f1c1ec4a10 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239764.839008:0:5779:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782239764.839035:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.132@tcp lock: 0000000094bc7ff1/0x8c5345f1c1ec4a09 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c5345f1c1ec4a10 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239764.839042:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.132@tcp lock: 0000000094bc7ff1/0x8c5345f1c1ec4a09 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c5345f1c1ec4a10 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239764.839060:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782239764.839061:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782239764.839063:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782239764.839155:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000666edced pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3305:1868813758893056:0@lo:103: 00000100:00100000:3.0:1782239764.839222:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239764.839599:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758893056 00000100:00100000:1.0:1782239764.839607:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758893056 00010000:00010000:1.0:1782239764.839636:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000fb62dd40/0x8c5345f1c1ec4a10 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c5345f1c1ec4a09 expref: 13 pid: 5785 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239764.839672:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782239764.839680:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000265ea93d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+13:3305:x1868813758893056:12345-0@lo:103: 00010000:00010000:1.0:1782239764.839692:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782239764.839697:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000fb62dd40/0x8c5345f1c1ec4a10 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c5345f1c1ec4a09 expref: 13 pid: 5785 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239764.839707:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000fb62dd40/0x8c5345f1c1ec4a10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8c5345f1c1ec4a09 expref: 13 pid: 5785 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239764.839720:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000fb62dd40/0x8c5345f1c1ec4a10 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8c5345f1c1ec4a09 expref: 13 pid: 5785 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239764.839733:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000004bf6b0a4/0x8c5345f1c1ec4a41 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239764.839790:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004bf6b0a4/0x8c5345f1c1ec4a41 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1782239764.839804:0:5775:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006535185s 00010000:00010000:1.0:1782239764.839808:0:5775:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000004bf6b0a4/0x8c5345f1c1ec4a41 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239764.839813:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000004bf6b0a4/0x8c5345f1c1ec4a41 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239764.839819:0:5775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000004bf6b0a4/0x8c5345f1c1ec4a41 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239764.839824:0:5775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000004bf6b0a4/0x8c5345f1c1ec4a41 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239764.839830:0:5775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000004bf6b0a4 already unused, calling callback (00000000bc3818f0) 00010000:00010000:1.0:1782239764.839833:0:5775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000004bf6b0a4/0x8c5345f1c1ec4a41 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239764.839840:0:5775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000004bf6b0a4/0x8c5345f1c1ec4a41 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239764.839855:0:5775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000004bf6b0a4/0x8c5345f1c1ec4a41 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239764.839866:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782239764.839908:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000265ea93d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+12:3305:x1868813758893056:12345-0@lo:103: Request processed in 229us (687us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239764.839916:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782239764.839960:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000666edced pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3305:1868813758893056:0@lo:103: 00010000:00010000:2.0:1782239764.840038:0:5806:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000004bf6b0a4/0x8c5345f1c1ec4a41 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239764.840046:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000004bf6b0a4/0x8c5345f1c1ec4a41 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239764.840051:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000004bf6b0a4/0x8c5345f1c1ec4a41 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239764.841622:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ceab3a8a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+11:5771:x1868813758892800:12345-0@lo:253: Request processed in 45360us (46736us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239764.841635:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1782239764.841741:0:5771:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000a34092c4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5771:1868813758892800:0@lo:253: 10000000:01000000:2.0:1782239764.841783:0:5771:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1782239764.841786:0:5771:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1782239764.841787:0:5771:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1782239764.841800:0:5771:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782239764.841801:0:5771:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782239764.841802:0:5771:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782239764.841803:0:5771:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782239764.841804:0:5771:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1782239764.841805:0:5771:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1782239764.841806:0:5771:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1782239764.841808:0:5771:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1782239764.841809:0:5771:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782239764.841810:0:5771:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1782239764.841822:0:5771:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1782239764.852545:0:5771:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1782239764.852989:0:5771:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1782239764.853209:0:5771:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1782239764.853389:0:5771:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1782239764.853603:0:5771:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1782239764.853809:0:5771:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1782239764.859060:0:5771:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1782239764.859648:0:5771:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1782239764.859910:0:5771:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1782239764.860091:0:5771:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1782239764.860653:0:5771:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1782239764.860874:0:5771:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:3.0:1782239764.905178:0:5771:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:0.0:1782239764.938103:0:5771:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1782239764.938277:0:5823:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:3.0:1782239764.938281:0:5823:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:1.0:1782239764.938423:0:5824:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1782239764.941240:0:5771:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1782239764.941407:0:5771:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1782239764.941872:0:5771:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1782239764.941879:0:5771:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1782239764.942019:0:5771:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1782239764.943436:0:5771:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1782239764.945066:0:5771:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1782239764.945112:0:5771:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1782239764.945391:0:5771:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1782239764.945587:0:5771:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:0.0:1782239764.947444:0:5771:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1782239764.948011:0:5771:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1782239764.948179:0:5771:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1782239764.948348:0:5771:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1782239764.948495:0:5771:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1782239764.948712:0:5771:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1782239764.949076:0:5771:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1782239764.949236:0:5771:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1782239764.949365:0:5771:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1782239764.949542:0:5771:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1782239764.949686:0:5771:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1782239764.950198:0:5771:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1782239764.950336:0:5771:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1782239764.950511:0:5771:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1782239764.952129:0:5771:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1782239764.952475:0:5771:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1782239764.952953:0:5771:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1782239764.953132:0:5771:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1782239764.953278:0:5771:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1782239764.953423:0:5771:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1782239764.953595:0:5771:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1782239764.954248:0:5771:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1782239764.954402:0:5771:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1782239764.954567:0:5771:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1782239764.954970:0:5771:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1782239764.955139:0:5771:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1782239764.955289:0:5771:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1782239764.955438:0:5771:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1782239764.955976:0:5771:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1782239764.956135:0:5771:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1782239764.956302:0:5771:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1782239764.956462:0:5771:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1782239764.957313:0:5771:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:3.0:1782239765.034230:0:5824:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:0.0:1782239765.121668:0:5771:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1782239765.121703:0:5771:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffc134c1d73988 00100000:10000000:0.0:1782239765.121712:0:5771:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1782239765.122230:0:5771:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1782239765.122247:0:5771:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.132@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1782239765.122260:0:5771:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1782239765.122276:0:5771:0:(super25.c:187:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:1.0:1782239765.184789:0:5824:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1782239765.184858:0:5824:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 1, retries 0 00000004:00080000:1.0:1782239765.184862:0:5824:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:2.0:1782239765.744269:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782239766.751028:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782239767.774862:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782239768.802123:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782239769.827651:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1782239769.890072:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1782239769.890083:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1782239769.890085:0:38:0:(import.c:65:import_set_state_nolock()) 000000008849475f lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1782239769.890096:0:38:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000008849475f using connection 192.168.203.132@tcp/0@lo 00000100:00100000:3.0:1782239769.890114:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000009ab0bb x1868813758893312/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1782239769.890161:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000009ab0bb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1868813758893312:0@lo:38: 00000100:00100000:3.0:1782239769.890224:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239769.890785:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000080048b48 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3306:1868813758893184:0@lo:400: 00000100:00100000:2.0:1782239769.890826:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239769.892525:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758893312 00000100:00100000:1.0:1782239769.892539:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758893312 00000100:00100000:1.0:1782239769.892583:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782239769.892589:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000054e15663 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3303:x1868813758893312:12345-0@lo:38: 00010000:00080000:1.0:1782239769.892617:0:5792:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 148 last 0 00000020:00000080:1.0:1782239769.892661:0:5792:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x8c5345f1c1ec4a48 00000004:00100000:1.0:1782239769.892699:0:5792:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1782239769.893011:0:5792:0:(import.c:65:import_set_state_nolock()) 000000005f206ba0 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782239769.893084:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000054e15663 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1868813758893312:12345-0@lo:38: Request processed in 494us (2861us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239769.893093:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782239769.895610:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758893184 00000100:00100000:3.0:1782239769.895624:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758893184 00000100:00100000:3.0:1782239769.895681:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1782239769.895689:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fd72fc9f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+11:3306:x1868813758893184:12345-0@lo:400: 00000100:00100000:3.0:1782239769.895795:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fd72fc9f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+11:3306:x1868813758893184:12345-0@lo:400: Request processed in 106us (4968us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239769.895802:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1782239769.895856:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000080048b48 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3306:1868813758893184:0@lo:400: 00010000:00080000:0.0:1782239769.896972:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000009ab0bb x1868813758893312/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782239779 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1782239769.896992:0:3303:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1782239769.897001:0:3303:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1782239769.897006:0:3303:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1782239769.897010:0:3303:0:(import.c:65:import_set_state_nolock()) 000000008849475f lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1782239769.897018:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000009ab0bb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1868813758893312:0@lo:38: 00000001:02000400:0.0:1782239770.073328:0:6067:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg332-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1782239770.847045:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1782239770.912815:0:5787:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1782239770.912823:0:5787:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9bb5c8415000 from 3 10000000:01000000:2.0:1782239770.912828:0:5787:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1782239770.912868:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: 00000000bf745047/0x8c5345f1c1ec4a4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239770.912881:0:5787:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: 00000000bf745047/0x8c5345f1c1ec4a4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239770.912891:0:5787:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: 00000000bf745047/0x8c5345f1c1ec4a4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239770.912923:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000a34092c4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758893440:0@lo:101: 00000100:00100000:2.0:1782239770.912992:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239770.913034:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set 0000000005386ca7 going to sleep for 11 seconds 00000100:00100000:1.0:1782239770.913203:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758893440 00000100:00100000:1.0:1782239770.913211:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758893440 00000100:00100000:1.0:1782239770.913252:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1782239770.913260:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000030619380 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+11:5787:x1868813758893440:12345-0@lo:101: 00010000:00010000:1.0:1782239770.913273:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782239770.913285:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e4bb5e0b/0x8c5345f1c1ec4a56 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c5345f1c1ec4a4f expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239770.913315:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e4bb5e0b/0x8c5345f1c1ec4a56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4a4f expref: 12 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239770.913324:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e4bb5e0b/0x8c5345f1c1ec4a56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4a4f expref: 12 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239770.913333:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e4bb5e0b, rc 0) 00000100:00100000:1.0:1782239770.913373:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000030619380 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+12:5787:x1868813758893440:12345-0@lo:101: Request processed in 114us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239770.913381:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1782239770.913456:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000a34092c4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758893440:0@lo:101: 00010000:00010000:1.0:1782239770.913472:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: 00000000bf745047/0x8c5345f1c1ec4a4f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4a56 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239770.913480:0:5787:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: 00000000bf745047/0x8c5345f1c1ec4a4f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c5345f1c1ec4a56 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239770.913539:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000666edced pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758893568:0@lo:256: 00000100:00100000:1.0:1782239770.913570:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239770.913581:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set 00000000dd2cff5f going to sleep for 11 seconds 00000100:00100000:3.0:1782239770.913972:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758893568 00000100:00100000:3.0:1782239770.913978:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758893568 00000100:00100000:3.0:1782239770.914010:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1782239770.914017:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ffbb41d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+12:5787:x1868813758893568:12345-0@lo:256: 20000000:01000000:3.0:1782239770.914033:0:5784:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1782239770.914050:0:5784:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1782239770.914053:0:5784:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1782239770.914144:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ffbb41d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+12:5787:x1868813758893568:12345-0@lo:256: Request processed in 128us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239770.914152:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1782239770.914217:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000666edced pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758893568:0@lo:256: 10000000:01000000:2.0:1782239770.914259:0:5787:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1782239770.914266:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: 00000000bf745047/0x8c5345f1c1ec4a4f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4a56 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239770.914273:0:5787:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: 00000000bf745047/0x8c5345f1c1ec4a4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4a56 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239771.871220:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782239772.895026:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782239773.923242:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782239774.943123:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782239775.009916:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000f7d64e20 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3307:1868813758893696:0@lo:400: 00000100:00100000:3.0:1782239775.009991:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239775.010059:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000009af72212 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1868813758893824:0@lo:400: 00000100:00100000:3.0:1782239775.010098:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239775.010144:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758893696 00000100:00100000:3.0:1782239775.010152:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758893696 00000100:00100000:3.0:1782239775.010213:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1782239775.010222:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000529268ab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+12:3307:x1868813758893696:12345-0@lo:400: 00000100:00100000:3.0:1782239775.010270:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000529268ab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+12:3307:x1868813758893696:12345-0@lo:400: Request processed in 51us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239775.010277:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1782239775.010311:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758893824 00000100:00100000:3.0:1782239775.010315:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758893824 00000100:00100000:3.0:1782239775.010344:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782239775.010351:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cdd4d5f3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1868813758893824:12345-0@lo:400: 00000100:00100000:3.0:1782239775.010415:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cdd4d5f3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1868813758893824:12345-0@lo:400: Request processed in 65us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239775.010423:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1782239775.010443:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000009af72212 x1868813758893824/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782239791 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782239775.010458:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000f7d64e20 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3307:1868813758893696:0@lo:400: 00000100:00100000:1.0:1782239775.010459:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000009af72212 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1868813758893824:0@lo:400: 00000020:00000080:3.0:1782239775.392416:0:6269:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffec1f77d50 20000000:00000080:3.0:1782239775.392434:0:6269:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9bb5c50b9400 uarg=0000000000000000 20000000:01000000:3.0:1782239775.392472:0:6269:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1782239775.392479:0:6269:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1782239775.392484:0:6269:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1782239775.392725:0:6269:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1782239775.392737:0:6269:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:3.0:1782239775.398658:0:6269:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782239775.399191:0:6269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1782239775.399253:0:6269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1782239775.399300:0:6269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1782239775.399319:0:6269:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1782239775.399337:0:6269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000006e4d1564/0x8c5345f1c1ec4a5d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239775.399355:0:6269:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000c55c88c2/0x8c5345f1c1ec4a1e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4a17 expref: 11 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239775.399371:0:6269:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000006e4d1564/0x8c5345f1c1ec4a5d lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239775.399421:0:6269:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000c55c88c2/0x8c5345f1c1ec4a1e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8c5345f1c1ec4a17 expref: 11 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239775.399433:0:6269:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000c55c88c2/0x8c5345f1c1ec4a1e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8c5345f1c1ec4a17 expref: 11 pid: 5784 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239775.399448:0:6269:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000f7d64e20 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6269:1868813758893952:0@lo:104: 00000100:00100000:3.0:1782239775.399511:0:6269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239775.399626:0:6269:0:(client.c:2701:ptlrpc_set_wait()) set 000000005fa01eaa going to sleep for 11 seconds 00000100:00100000:0.0:1782239775.400202:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758893952 00000100:00100000:0.0:1782239775.400211:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758893952 00000100:00100000:0.0:1782239775.400264:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782239775.400272:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000031363298 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+3:6269:x1868813758893952:12345-0@lo:104: 00010000:00010000:0.0:1782239775.400285:0:5773:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.132@tcp lock: 000000008bd7ee43/0x8c5345f1c1ec4a17 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c5345f1c1ec4a1e expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239775.400355:0:5773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782239775.400360:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000031363298 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+3:6269:x1868813758893952:12345-0@lo:104: Request processed in 91us (851us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239775.400367:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1782239775.400445:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782239775.400458:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.132@tcp lock: 000000008bd7ee43/0x8c5345f1c1ec4a17 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c5345f1c1ec4a1e expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239775.400465:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008bd7ee43 already unused, calling callback (00000000731bd9ff) 10000000:00010000:1.0:1782239775.400468:0:5778:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.132@tcp lock: 000000008bd7ee43/0x8c5345f1c1ec4a17 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8c5345f1c1ec4a1e expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239775.400475:0:5778:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.132@tcp lock: 000000008bd7ee43/0x8c5345f1c1ec4a17 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8c5345f1c1ec4a1e expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782239775.400481:0:5778:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.132@tcp lock: 000000008bd7ee43/0x8c5345f1c1ec4a17 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8c5345f1c1ec4a1e expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782239775.400486:0:5778:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1782239775.400521:0:5778:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.132@tcp lock: 000000008bd7ee43/0x8c5345f1c1ec4a17 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c5345f1c1ec4a1e expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239775.400527:0:5778:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782239775.400545:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.132@tcp lock: 000000008bd7ee43/0x8c5345f1c1ec4a17 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c5345f1c1ec4a1e expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239775.400551:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.132@tcp lock: 000000008bd7ee43/0x8c5345f1c1ec4a17 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c5345f1c1ec4a1e expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239775.400566:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782239775.400567:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782239775.400569:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782239775.400581:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000783fdd94 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3305:1868813758894080:0@lo:103: 00000100:00100000:1.0:1782239775.400614:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239775.400655:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758894080 00000100:00100000:1.0:1782239775.400659:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758894080 00010000:00010000:1.0:1782239775.400683:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000c55c88c2/0x8c5345f1c1ec4a1e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c5345f1c1ec4a17 expref: 12 pid: 5784 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239775.400706:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782239775.400712:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d8c755cc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+12:3305:x1868813758894080:12345-0@lo:103: 00010000:00010000:1.0:1782239775.400722:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782239775.400726:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000c55c88c2/0x8c5345f1c1ec4a1e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c5345f1c1ec4a17 expref: 12 pid: 5784 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239775.400735:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000c55c88c2/0x8c5345f1c1ec4a1e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8c5345f1c1ec4a17 expref: 12 pid: 5784 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239775.400774:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000006e4d1564/0x8c5345f1c1ec4a5d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239775.400781:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006e4d1564/0x8c5345f1c1ec4a5d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239775.400795:0:5775:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006e4d1564/0x8c5345f1c1ec4a5d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239775.400801:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006e4d1564/0x8c5345f1c1ec4a5d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239775.400807:0:5775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000006e4d1564/0x8c5345f1c1ec4a5d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239775.400812:0:5775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000006e4d1564/0x8c5345f1c1ec4a5d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239775.400816:0:5775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006e4d1564 already unused, calling callback (00000000bc3818f0) 00010000:00010000:1.0:1782239775.400819:0:5775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000006e4d1564/0x8c5345f1c1ec4a5d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239775.400833:0:5775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000006e4d1564/0x8c5345f1c1ec4a5d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239775.400841:0:5775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000006e4d1564/0x8c5345f1c1ec4a5d lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239775.400850:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782239775.400878:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d8c755cc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+12:3305:x1868813758894080:12345-0@lo:103: Request processed in 167us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239775.400885:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782239775.400917:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000783fdd94 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3305:1868813758894080:0@lo:103: 00010000:00010000:2.0:1782239775.401106:0:6269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c55c88c2/0x8c5345f1c1ec4a1e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8c5345f1c1ec4a17 expref: 11 pid: 5784 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239775.401117:0:6269:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000f7d64e20 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6269:1868813758893952:0@lo:104: 00010000:00010000:2.0:1782239775.401131:0:6269:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000006e4d1564/0x8c5345f1c1ec4a5d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239775.401139:0:6269:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000006e4d1564/0x8c5345f1c1ec4a5d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239775.401145:0:6269:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000006e4d1564/0x8c5345f1c1ec4a5d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239775.401149:0:6269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006e4d1564/0x8c5345f1c1ec4a5d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239775.969351:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782239776.992501:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782239778.015934:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782239779.040697:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782239780.063446:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1782239780.126872:0:5787:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1782239780.126883:0:5787:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9bb5c8415000 from 1 10000000:01000000:0.0:1782239780.126890:0:5787:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1782239780.127096:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: 000000009509df19/0x8c5345f1c1ec4a64 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239780.127111:0:5787:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: 000000009509df19/0x8c5345f1c1ec4a64 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239780.127124:0:5787:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: 000000009509df19/0x8c5345f1c1ec4a64 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782239780.127156:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000910e31ee pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758894208:0@lo:101: 00000100:00100000:0.0:1782239780.127253:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239780.127502:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000d3e09a66 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1868813758894336:0@lo:400: 00000100:00100000:3.0:1782239780.127538:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239780.127579:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758894336 00000100:00100000:3.0:1782239780.127588:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758894336 00000100:00100000:2.0:1782239780.127846:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758894208 00000100:00100000:2.0:1782239780.127866:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758894208 00000100:00100000:2.0:1782239780.127902:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1782239780.127910:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000006665389 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+11:5787:x1868813758894208:12345-0@lo:101: 00010000:00010000:2.0:1782239780.127928:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782239780.127947:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000055df9d44/0x8c5345f1c1ec4a6b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c5345f1c1ec4a64 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239780.128483:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782239780.128494:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008cbbd1de pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1868813758894336:12345-0@lo:400: 00000100:00100000:3.0:1782239780.128583:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008cbbd1de pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1868813758894336:12345-0@lo:400: Request processed in 91us (1043us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239780.128591:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1782239780.128722:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000055df9d44/0x8c5345f1c1ec4a6b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4a64 expref: 12 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239780.128736:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000055df9d44/0x8c5345f1c1ec4a6b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4a64 expref: 12 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239780.128836:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000055df9d44, rc 0) 00000100:00100000:2.0:1782239780.128869:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000006665389 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+12:5787:x1868813758894208:12345-0@lo:101: Request processed in 960us (1617us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239780.128876:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1782239780.130441:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set 00000000007a782e going to sleep for 11 seconds 00000100:00100000:0.0:1782239780.130492:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000910e31ee pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758894208:0@lo:101: 00010000:00010000:0.0:1782239780.130528:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: 000000009509df19/0x8c5345f1c1ec4a64 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4a6b expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239780.130541:0:5787:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: 000000009509df19/0x8c5345f1c1ec4a64 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c5345f1c1ec4a6b expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782239780.130633:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000910e31ee pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758894464:0@lo:501: 00010000:00080000:2.0:1782239780.130863:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000d3e09a66 x1868813758894336/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782239796 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782239780.130878:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000d3e09a66 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1868813758894336:0@lo:400: 00000100:00100000:0.0:1782239780.133498:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239780.133558:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set 00000000007a782e going to sleep for 11 seconds 00000100:00100000:3.0:1782239780.134593:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758894464 00000100:00100000:3.0:1782239780.134611:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758894464 00000100:00100000:3.0:1782239780.134702:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1782239780.134713:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000076417ad3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+12:5787:x1868813758894464:12345-0@lo:501: 00000100:00100000:3.0:1782239780.137225:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000076417ad3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+12:5787:x1868813758894464:12345-0@lo:501: Request processed in 2502us (3723us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239780.137246:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1782239780.137493:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000910e31ee pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758894464:0@lo:501: 00000100:00100000:0.0:1782239780.137567:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000910e31ee pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758894592:0@lo:503: 00000100:00100000:0.0:1782239780.137643:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239780.137692:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set 00000000007a782e going to sleep for 11 seconds 00000100:00100000:1.0:1782239780.137698:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758894592 00000100:00100000:1.0:1782239780.137707:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758894592 00000100:00100000:1.0:1782239780.137775:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1782239780.137786:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003f1fbb53 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+12:5787:x1868813758894592:12345-0@lo:503: 00000100:00100000:1.0:1782239780.138036:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003f1fbb53 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+12:5787:x1868813758894592:12345-0@lo:503: Request processed in 251us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239780.138045:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1782239780.138095:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000910e31ee pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758894592:0@lo:503: 00000100:00100000:3.0:1782239780.141619:0:6565:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000375cbe3c pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:6565:1868813758894720:0@lo:502: 00000100:00100000:3.0:1782239780.141728:0:6565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239780.141794:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758894720 00000100:00100000:3.0:1782239780.141803:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758894720 00000100:00100000:3.0:1782239780.141861:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1782239780.141872:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e75f5b43 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+12:6565:x1868813758894720:12345-0@lo:502: 00000100:00100000:3.0:1782239780.142148:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e75f5b43 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+12:6565:x1868813758894720:12345-0@lo:502: Request processed in 278us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239780.142157:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1782239780.142223:0:6565:0:(client.c:2701:ptlrpc_set_wait()) set 00000000e8a086ba going to sleep for 11 seconds 00000100:00100000:3.0:1782239780.142248:0:6565:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000375cbe3c pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:6565:1868813758894720:0@lo:502: 00000020:01000000:3.0:1782239780.142290:0:6565:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782239780.142304:0:6565:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782239780.142307:0:6565:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1782239780.145150:0:6565:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bb5c8415000 00000020:00000080:3.0:1782239780.145159:0:6565:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1782239780.145251:0:6565:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb601358000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:6565:1868813758894848:0@lo:502: 00000100:00100000:3.0:1782239780.145601:0:6565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239780.145679:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758894848 00000100:00100000:3.0:1782239780.145687:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758894848 00000100:00100000:3.0:1782239780.145768:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1782239780.145781:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d1bad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+12:6565:x1868813758894848:12345-0@lo:502: 00000100:00100000:3.0:1782239780.146043:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d1bad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+12:6565:x1868813758894848:12345-0@lo:502: Request processed in 264us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239780.146058:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1782239780.146124:0:6565:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5d135ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1782239780.146151:0:6565:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb601358000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:6565:1868813758894848:0@lo:502: 00000020:01000000:3.0:1782239780.146186:0:6565:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782239780.146195:0:6565:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782239780.146197:0:6565:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1782239780.146202:0:6565:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1782239780.146294:0:5787:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1782239780.146467:0:5787:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1782239780.146481:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5c0030800/0x8c5345f1c1ec4a64 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4a6b expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239780.146492:0:5787:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff9bb5c0030800/0x8c5345f1c1ec4a64 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4a6b expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1782239780.630111:0:6585:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:2.0:1782239780.630117:0:6585:0:(obd_mount.c:917:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1782239780.630248:0:6585:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9bb5c8863000 00000020:01000004:2.0:1782239780.630271:0:6585:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1782239780.630286:0:6585:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1782239780.630306:0:6585:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9bb5ded00000) 00000020:00000080:2.0:1782239780.630414:0:6585:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1782239780.652931:0:6585:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1782239780.653247:0:6585:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1782239780.676434:0:6585:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1782239780.682609:0:6585:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1782239780.682723:0:6585:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1782239780.683109:0:6585:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1782239780.683138:0:6585:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1782239780.683891:0:6585:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1782239780.683905:0:6585:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1782239780.683918:0:6585:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x8c5345f1c1ec4a79 00000020:01000004:2.0:1782239780.683929:0:6585:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1782239780.683954:0:6585:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.203.132@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1782239780.683958:0:6585:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.132@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1782239780.683965:0:6585:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1782239780.683971:0:6585:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1782239780.684044:0:6585:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9bb5ded019c0) 00000020:00000080:2.0:1782239780.684057:0:6585:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:2.0:1782239780.685664:0:6585:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782239780.685898:0:6585:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1782239780.685905:0:6585:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1782239780.687089:0:6585:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1782239780.687101:0:6585:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1782239780.689256:0:6585:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1782239780.689270:0:6585:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1782239780.692825:0:6585:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782239780.693044:0:6585:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1782239780.693053:0:6585:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1782239780.697841:0:6585:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1782239780.697863:0:6585:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1782239780.724707:0:6585:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1782239780.725160:0:6585:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1782239780.725168:0:6585:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1782239780.727444:0:6585:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1782239780.727462:0:6585:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1782239780.728294:0:6585:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1782239780.728303:0:6585:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1782239780.736599:0:6585:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1782239780.737198:0:6585:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1782239780.737206:0:6585:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1782239780.738155:0:6585:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1782239780.738167:0:6585:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1782239780.800200:0:6585:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1782239780.800558:0:6585:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1782239780.800566:0:6585:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1782239780.805063:0:6585:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1782239780.805090:0:6585:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1782239780.805909:0:6585:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1782239780.805944:0:6585:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:1.0:1782239780.806009:0:6585:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.132@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1782239780.829118:0:6585:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.132@tcp ctxt 0 is initialized 00000020:01000004:2.0:1782239780.829170:0:6585:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.132@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1782239780.829175:0:6585:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1782239780.829177:0:6585:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1782239780.829179:0:6585:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782239780.829180:0:6585:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782239780.829181:0:6585:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782239780.829183:0:6585:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782239780.829185:0:6585:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782239780.829186:0:6585:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1782239780.829187:0:6585:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1782239780.829194:0:6585:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782239780.829195:0:6585:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1782239780.829199:0:6585:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1782239780.829201:0:6585:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1782239780.829202:0:6585:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1782239780.829203:0:6585:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782239780.829204:0:6585:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782239780.829205:0:6585:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782239780.829206:0:6585:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782239780.829206:0:6585:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782239780.829207:0:6585:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1782239780.829208:0:6585:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1782239780.829209:0:6585:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782239780.829210:0:6585:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1782239780.829244:0:6585:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1782239780.829268:0:6585:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f48c0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:6585:1868813758894976:0@lo:253: 00000100:00100000:2.0:1782239780.829446:0:6585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239780.829516:0:6585:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5d135ca80 going to sleep for 11 seconds 00000100:00100000:3.0:1782239780.829693:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758894976 00000100:00100000:3.0:1782239780.829704:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758894976 00000100:00100000:3.0:1782239780.829850:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1782239780.829860:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d1baf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+12:6585:x1868813758894976:12345-0@lo:253: 20000000:01000000:3.0:1782239780.829913:0:5785:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1782239780.829919:0:5785:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:3.0:1782239780.829925:0:5785:0:(mgs_llog.c:867:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:3.0:1782239780.829929:0:5785:0:(mgs_llog.c:3853:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:3.0:1782239780.831232:0:5785:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782239780.831874:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:3.0:1782239780.831893:0:5785:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:3.0:1782239780.832005:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:3.0:1782239780.832017:0:5785:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:3.0:1782239780.832054:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:3.0:1782239780.832137:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:3.0:1782239780.832880:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:3.0:1782239780.832908:0:5785:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.203.132@tcp 20000000:01000000:3.0:1782239780.832911:0:5785:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.203.132@tcp (null) (null) (null) 00000040:00080000:3.0:1782239780.833005:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:3.0:1782239780.833016:0:5785:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1782239780.833067:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:3.0:1782239780.833075:0:5785:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.132@tcp (null) (null) 00000040:00080000:3.0:1782239780.833102:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:3.0:1782239780.833110:0:5785:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1782239780.833137:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:3.0:1782239780.833207:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:3.0:1782239780.834312:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:3.0:1782239780.835298:0:5785:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.203.132@tcp 20000000:01000000:3.0:1782239780.835302:0:5785:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.203.132@tcp (null) (null) (null) 00000040:00080000:3.0:1782239780.835398:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:3.0:1782239780.835408:0:5785:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1782239780.835465:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:3.0:1782239780.835474:0:5785:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.132@tcp (null) (null) 00000040:00080000:3.0:1782239780.835542:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:3.0:1782239780.835552:0:5785:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1782239780.835586:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:3.0:1782239780.836434:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:3.0:1782239780.836465:0:5785:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:3.0:1782239780.836469:0:5785:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:3.0:1782239780.836476:0:5785:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1782239780.836478:0:5785:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1782239780.836480:0:5785:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1782239780.836497:0:5785:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1782239780.836500:0:5785:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1782239780.836552:0:5785:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1782239780.836555:0:5785:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1782239780.838188:0:6601:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:3.0:1782239780.838294:0:6601:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:3.0:1782239780.838342:0:6601:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:1.0:1782239780.838936:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:1.0:1782239780.839061:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:1.0:1782239780.839099:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:1.0:1782239780.839114:0:5785:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1782239780.839116:0:5785:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1782239780.839604:0:6602:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1782239780.839724:0:6602:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1782239780.840053:0:6602:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:1.0:1782239780.840386:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:1.0:1782239780.840428:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:1.0:1782239780.840484:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:1.0:1782239780.840499:0:5785:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1782239780.840501:0:5785:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1782239780.841337:0:6603:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:0.0:1782239780.841692:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:0.0:1782239780.841742:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:0.0:1782239780.841921:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 10000000:01000000:0.0:1782239780.841958:0:5785:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1782239780.841984:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bb5c0030a00/0x8c5345f1c1ec4a87 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239780.842019:0:5785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bb5c0031400/0x8c5345f1c1ec49a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4999 expref: 12 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239780.842029:0:5785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bb5c1677000/0x8c5345f1c1ec49bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c5345f1c1ec49b5 expref: 12 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239780.842036:0:5785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bb5c0031a00/0x8c5345f1c1ec4a2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4a25 expref: 12 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239780.842043:0:5785:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bb5c0030a00/0x8c5345f1c1ec4a87 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239780.842094:0:5785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bb5c0031a00/0x8c5345f1c1ec4a2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8c5345f1c1ec4a25 expref: 12 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239780.842114:0:5785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bb5c0031a00/0x8c5345f1c1ec4a2c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8c5345f1c1ec4a25 expref: 12 pid: 5783 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782239780.842132:0:5785:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5dee24380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5785:1868813758895104:0@lo:104: 00000100:00100000:0.0:1782239780.842222:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782239780.842342:0:5785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bb5c1677000/0x8c5345f1c1ec49bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8c5345f1c1ec49b5 expref: 12 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239780.842361:0:5785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bb5c1677000/0x8c5345f1c1ec49bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8c5345f1c1ec49b5 expref: 12 pid: 5784 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782239780.842369:0:5785:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5dee24700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5785:1868813758895232:0@lo:104: 00000100:00100000:0.0:1782239780.842390:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782239780.842575:0:5785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bb5c0031400/0x8c5345f1c1ec49a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8c5345f1c1ec4999 expref: 12 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239780.842591:0:5785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bb5c0031400/0x8c5345f1c1ec49a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8c5345f1c1ec4999 expref: 12 pid: 5784 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782239780.842600:0:5785:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5dee25500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5785:1868813758895360:0@lo:104: 00000100:00100000:0.0:1782239780.842635:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239780.842733:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758895104 00000100:00100000:3.0:1782239780.842743:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758895104 00000100:00100000:3.0:1782239780.842817:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758895232 00000100:00100000:3.0:1782239780.842820:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758895232 00000100:00100000:3.0:1782239780.842833:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1782239780.842842:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5dee24a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+4:5785:x1868813758895104:12345-0@lo:104: 00010000:00010000:3.0:1782239780.842857:0:5773:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.132@tcp lock: ffff9bb5c1677800/0x8c5345f1c1ec4a25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c5345f1c1ec4a2c expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239780.842909:0:5773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782239780.842915:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5dee24a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+4:5785:x1868813758895104:12345-0@lo:104: Request processed in 74us (695us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239780.842923:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1782239780.842940:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1782239780.843024:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782239780.843033:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.132@tcp lock: ffff9bb5c1677800/0x8c5345f1c1ec4a25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c5345f1c1ec4a2c expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239780.843041:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5c1677800 already unused, calling callback (ffffffffc1d0cc20) 10000000:00010000:2.0:1782239780.843046:0:5778:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.132@tcp lock: ffff9bb5c1677800/0x8c5345f1c1ec4a25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8c5345f1c1ec4a2c expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239780.843056:0:5778:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.132@tcp lock: ffff9bb5c1677800/0x8c5345f1c1ec4a25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8c5345f1c1ec4a2c expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782239780.843063:0:5778:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.132@tcp lock: ffff9bb5c1677800/0x8c5345f1c1ec4a25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8c5345f1c1ec4a2c expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782239780.843069:0:5778:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1782239780.843113:0:5778:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.132@tcp lock: ffff9bb5c1677800/0x8c5345f1c1ec4a25 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c5345f1c1ec4a2c expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239780.843120:0:5778:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782239780.843140:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.132@tcp lock: ffff9bb5c1677800/0x8c5345f1c1ec4a25 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c5345f1c1ec4a2c expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239780.843147:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.132@tcp lock: ffff9bb5c1677800/0x8c5345f1c1ec4a25 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c5345f1c1ec4a2c expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239780.843164:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782239780.843166:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782239780.843168:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782239780.843190:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f48c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3307:1868813758895488:0@lo:103: 00000100:00100000:2.0:1782239780.843223:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239780.843272:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758895488 00000100:00100000:2.0:1782239780.843275:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758895488 00010000:00010000:2.0:1782239780.843294:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bb5c0031a00/0x8c5345f1c1ec4a2c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c5345f1c1ec4a25 expref: 13 pid: 5783 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239780.843316:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782239780.843322:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+13:3307:x1868813758895488:12345-0@lo:103: 00010000:00010000:2.0:1782239780.843332:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782239780.843336:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bb5c0031a00/0x8c5345f1c1ec4a2c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c5345f1c1ec4a25 expref: 13 pid: 5783 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239780.843346:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bb5c0031a00/0x8c5345f1c1ec4a2c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8c5345f1c1ec4a25 expref: 13 pid: 5783 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239780.843376:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782239780.843410:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+13:3307:x1868813758895488:12345-0@lo:103: Request processed in 88us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239780.843416:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782239780.843460:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f48c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3307:1868813758895488:0@lo:103: 00000100:00100000:3.0:1782239780.843510:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5dee26300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+3:5785:x1868813758895232:12345-0@lo:104: 00010000:00010000:3.0:1782239780.843518:0:5773:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a44200/0x8c5345f1c1ec49b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c5345f1c1ec49bc expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239780.843559:0:5773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782239780.843565:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5dee26300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+3:5785:x1868813758895232:12345-0@lo:104: Request processed in 58us (1174us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239780.843572:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1782239780.843629:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782239780.843634:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a44200/0x8c5345f1c1ec49b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c5345f1c1ec49bc expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239780.843641:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5c2a44200 already unused, calling callback (ffffffffc1d0cc20) 10000000:00010000:2.0:1782239780.843644:0:5779:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a44200/0x8c5345f1c1ec49b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8c5345f1c1ec49bc expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239780.843652:0:5779:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a44200/0x8c5345f1c1ec49b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8c5345f1c1ec49bc expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782239780.843657:0:5779:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a44200/0x8c5345f1c1ec49b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8c5345f1c1ec49bc expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782239780.843663:0:5779:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1782239780.843688:0:5779:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a44200/0x8c5345f1c1ec49b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c5345f1c1ec49bc expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239780.843694:0:5779:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782239780.843710:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a44200/0x8c5345f1c1ec49b5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c5345f1c1ec49bc expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239780.843716:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a44200/0x8c5345f1c1ec49b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c5345f1c1ec49bc expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239780.843725:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782239780.843732:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782239780.843734:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782239780.843745:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f48c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3304:1868813758895616:0@lo:103: 00000100:00100000:2.0:1782239780.843796:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239780.843832:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758895616 00000100:00100000:2.0:1782239780.843836:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758895616 00010000:00010000:2.0:1782239780.843852:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bb5c1677000/0x8c5345f1c1ec49bc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c5345f1c1ec49b5 expref: 13 pid: 5784 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239780.843871:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1782239780.843877:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+13:3304:x1868813758895616:12345-0@lo:103: 00010000:00010000:2.0:1782239780.843885:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782239780.843888:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bb5c1677000/0x8c5345f1c1ec49bc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c5345f1c1ec49b5 expref: 13 pid: 5784 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239780.843896:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bb5c1677000/0x8c5345f1c1ec49bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8c5345f1c1ec49b5 expref: 13 pid: 5784 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239780.843906:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782239780.843931:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+13:3304:x1868813758895616:12345-0@lo:103: Request processed in 54us (134us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239780.843936:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1782239780.843969:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f48c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3304:1868813758895616:0@lo:103: 00000100:00100000:0.0:1782239780.844313:0:5785:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c8692b40 going to sleep for 11 seconds 00010000:00010000:0.0:1782239780.844330:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb5c0031a00/0x8c5345f1c1ec4a2c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8c5345f1c1ec4a25 expref: 12 pid: 5783 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782239780.844339:0:5785:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5dee24380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5785:1868813758895104:0@lo:104: 00010000:00010000:0.0:1782239780.844360:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb5c1677000/0x8c5345f1c1ec49bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8c5345f1c1ec49b5 expref: 11 pid: 5784 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782239780.844371:0:5785:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5dee24700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5785:1868813758895232:0@lo:104: 00000100:00100000:3.0:1782239780.844434:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758895360 00000100:00100000:3.0:1782239780.844448:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758895360 00000100:00100000:3.0:1782239780.844470:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1782239780.844476:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5dee24e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+3:5785:x1868813758895360:12345-0@lo:104: 00010000:00010000:3.0:1782239780.844486:0:5773:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.132@tcp lock: ffff9bb602044e00/0x8c5345f1c1ec4999 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c5345f1c1ec49a0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239780.844568:0:5773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782239780.844574:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5dee24e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+3:5785:x1868813758895360:12345-0@lo:104: Request processed in 98us (1939us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239780.844580:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1782239780.844642:0:5785:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5dee25500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5785:1868813758895360:0@lo:104: 00010000:00010000:0.0:1782239780.844668:0:5785:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bb5c0030a00/0x8c5345f1c1ec4a87 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239780.845047:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782239780.845054:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.132@tcp lock: ffff9bb602044e00/0x8c5345f1c1ec4999 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c5345f1c1ec49a0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239780.845063:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb602044e00 already unused, calling callback (ffffffffc1d0cc20) 10000000:00010000:2.0:1782239780.845067:0:5778:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.132@tcp lock: ffff9bb602044e00/0x8c5345f1c1ec4999 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8c5345f1c1ec49a0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239780.845088:0:5778:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.132@tcp lock: ffff9bb602044e00/0x8c5345f1c1ec4999 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8c5345f1c1ec49a0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782239780.845094:0:5778:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.132@tcp lock: ffff9bb602044e00/0x8c5345f1c1ec4999 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8c5345f1c1ec49a0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782239780.845099:0:5778:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1782239780.845135:0:5778:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.132@tcp lock: ffff9bb602044e00/0x8c5345f1c1ec4999 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c5345f1c1ec49a0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239780.845141:0:5778:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782239780.845157:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.132@tcp lock: ffff9bb602044e00/0x8c5345f1c1ec4999 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c5345f1c1ec49a0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239780.845164:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.132@tcp lock: ffff9bb602044e00/0x8c5345f1c1ec4999 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c5345f1c1ec49a0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239780.845178:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782239780.845180:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782239780.845181:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782239780.845188:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782239780.845198:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f48c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3304:1868813758895744:0@lo:103: 00000100:00100000:2.0:1782239780.845235:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239780.845271:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758895744 00000100:00100000:2.0:1782239780.845274:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758895744 00010000:00010000:2.0:1782239780.845294:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bb5c0031400/0x8c5345f1c1ec49a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c5345f1c1ec4999 expref: 11 pid: 5784 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239780.845315:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1782239780.845321:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+11:3304:x1868813758895744:12345-0@lo:103: 00010000:00010000:2.0:1782239780.845337:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782239780.845342:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bb5c0031400/0x8c5345f1c1ec49a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c5345f1c1ec4999 expref: 11 pid: 5784 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239780.845363:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bb5c0031400/0x8c5345f1c1ec49a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8c5345f1c1ec4999 expref: 11 pid: 5784 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239780.845376:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb5c0031400/0x8c5345f1c1ec49a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8c5345f1c1ec4999 expref: 11 pid: 5784 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239780.845389:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bb5c0030a00/0x8c5345f1c1ec4a87 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239780.845398:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb5c0030a00/0x8c5345f1c1ec4a87 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239780.845413:0:5775:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bb5c0030a00/0x8c5345f1c1ec4a87 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239780.845420:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bb5c0030a00/0x8c5345f1c1ec4a87 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239780.845427:0:5775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bb5c0030a00/0x8c5345f1c1ec4a87 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239780.845432:0:5775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bb5c0030a00/0x8c5345f1c1ec4a87 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239780.845437:0:5775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5c0030a00 already unused, calling callback (ffffffffc1728ce0) 00010000:00010000:2.0:1782239780.845441:0:5775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bb5c0030a00/0x8c5345f1c1ec4a87 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239780.845457:0:5775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bb5c0030a00/0x8c5345f1c1ec4a87 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239780.845616:0:5775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bb5c0030a00/0x8c5345f1c1ec4a87 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239780.845695:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782239780.845739:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+10:3304:x1868813758895744:12345-0@lo:103: Request processed in 416us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239780.845771:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1782239780.845861:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f48c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3304:1868813758895744:0@lo:103: 00010000:00010000:0.0:1782239780.846010:0:5785:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bb5c0030a00/0x8c5345f1c1ec4a87 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239780.846018:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bb5c0030a00/0x8c5345f1c1ec4a87 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239780.846024:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb5c0030a00/0x8c5345f1c1ec4a87 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1782239780.846040:0:5785:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1782239780.889157:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d1baf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+9:6585:x1868813758894976:12345-0@lo:253: Request processed in 59286us (59699us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239780.889177:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1782239780.889303:0:6585:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f48c0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:6585:1868813758894976:0@lo:253: 10000000:01000000:2.0:1782239780.889322:0:6585:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1782239780.889326:0:6585:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1782239780.889328:0:6585:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1782239780.889329:0:6585:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782239780.889331:0:6585:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1782239780.889332:0:6585:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782239780.889334:0:6585:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782239780.889335:0:6585:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782239780.889337:0:6585:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1782239780.889339:0:6585:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782239780.889340:0:6585:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1782239780.889375:0:6585:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9bb5c8863000 from lustre-OST0000 10000000:01000000:2.0:1782239780.889408:0:6585:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1782239780.889411:0:6585:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1782239780.889419:0:6585:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9bb5d1bd99c0 local copy 10000000:01000000:2.0:1782239780.889424:0:6585:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1782239780.889471:0:6585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb602044e00/0x8c5345f1c1ec4a8e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239780.889484:0:6585:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.132@tcp lock: ffff9bb602044e00/0x8c5345f1c1ec4a8e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239780.889512:0:6585:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff9bb602044e00/0x8c5345f1c1ec4a8e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239780.889537:0:6585:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f48c0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:6585:1868813758895872:0@lo:101: 00000100:00100000:2.0:1782239780.889582:0:6585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239780.889656:0:6585:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5d135c240 going to sleep for 11 seconds 00000100:00100000:3.0:1782239780.889812:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758895872 00000100:00100000:3.0:1782239780.889822:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758895872 00000100:00100000:3.0:1782239780.889868:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1782239780.889877:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d1badc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+9:6585:x1868813758895872:12345-0@lo:101: 00010000:00010000:3.0:1782239780.889893:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782239780.889908:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb5c2a45e00/0x8c5345f1c1ec4a95 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c5345f1c1ec4a8e expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239780.889936:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb5c2a45e00/0x8c5345f1c1ec4a95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4a8e expref: 10 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239780.889948:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb5c2a45e00/0x8c5345f1c1ec4a95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4a8e expref: 10 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239780.889959:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5c2a45e00, rc 0) 00000100:00100000:3.0:1782239780.889998:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d1badc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+10:6585:x1868813758895872:12345-0@lo:101: Request processed in 123us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239780.890005:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1782239780.890115:0:6585:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f48c0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:6585:1868813758895872:0@lo:101: 00010000:00010000:2.0:1782239780.890130:0:6585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff9bb602044e00/0x8c5345f1c1ec4a8e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x8c5345f1c1ec4a95 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239780.890139:0:6585:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff9bb602044e00/0x8c5345f1c1ec4a8e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x8c5345f1c1ec4a95 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239780.890266:0:6585:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f48c0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:6585:1868813758896000:0@lo:501: 00000100:00100000:2.0:1782239780.890294:0:6585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239780.890361:0:6585:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5d135c240 going to sleep for 11 seconds 00000100:00100000:1.0:1782239780.890493:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758896000 00000100:00100000:1.0:1782239780.890498:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758896000 00000100:00100000:1.0:1782239780.890562:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1782239780.890570:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d1bac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+10:6585:x1868813758896000:12345-0@lo:501: 00000100:00100000:1.0:1782239780.890855:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d1bac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+10:6585:x1868813758896000:12345-0@lo:501: Request processed in 285us (559us total) trans 0 rc -2/-2 00000100:00100000:1.0:1782239780.890863:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1782239780.890930:0:6585:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f48c0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:6585:1868813758896000:0@lo:501: 10000000:01000000:2.0:1782239780.890945:0:6585:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.132@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1782239780.890973:0:6585:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.132@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1782239780.890979:0:6585:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb602044e00/0x8c5345f1c1ec4a8e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x8c5345f1c1ec4a95 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239780.890988:0:6585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb602044e00/0x8c5345f1c1ec4a8e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x8c5345f1c1ec4a95 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239780.890995:0:6585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.132@tcp lock: ffff9bb602044e00/0x8c5345f1c1ec4a8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x8c5345f1c1ec4a95 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239780.891029:0:6585:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1782239780.891049:0:6585:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9bb5c8863000 10000000:01000000:2.0:1782239780.891054:0:6585:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1782239780.891060:0:6585:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9bb5d1bd99c0 10000000:01000000:2.0:1782239780.891062:0:6585:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1782239780.891066:0:6585:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff9bb5d1bd99c0 from 1 10000000:01000000:2.0:1782239780.891068:0:6585:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1782239780.891089:0:6585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb602044800/0x8c5345f1c1ec4a9c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239780.891097:0:6585:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: ffff9bb602044800/0x8c5345f1c1ec4a9c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239780.891107:0:6585:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff9bb602044800/0x8c5345f1c1ec4a9c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239780.891120:0:6585:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f48c0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:6585:1868813758896128:0@lo:101: 00000100:00100000:2.0:1782239780.891146:0:6585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782239780.891240:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782239780.891248:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.132@tcp lock: ffff9bb602044e00/0x8c5345f1c1ec4a8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x8c5345f1c1ec4a95 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239780.891257:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb602044e00 already unused, calling callback (ffffffffc1d0cc20) 10000000:00010000:0.0:1782239780.891260:0:5779:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.132@tcp lock: ffff9bb602044e00/0x8c5345f1c1ec4a8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x8c5345f1c1ec4a95 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239780.891270:0:5779:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.132@tcp lock: ffff9bb602044e00/0x8c5345f1c1ec4a8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x8c5345f1c1ec4a95 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782239780.891277:0:5779:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.132@tcp lock: ffff9bb602044e00/0x8c5345f1c1ec4a8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x8c5345f1c1ec4a95 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782239780.891283:0:5779:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1782239780.891302:0:5779:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.132@tcp lock: ffff9bb602044e00/0x8c5345f1c1ec4a8e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x8c5345f1c1ec4a95 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239780.891309:0:5779:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782239780.891327:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.132@tcp lock: ffff9bb602044e00/0x8c5345f1c1ec4a8e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x8c5345f1c1ec4a95 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239780.891334:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.132@tcp lock: ffff9bb602044e00/0x8c5345f1c1ec4a8e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x8c5345f1c1ec4a95 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239780.891360:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782239780.891362:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782239780.891364:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782239780.891484:0:6585:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5d135c0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782239780.891499:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5dee25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3306:1868813758896256:0@lo:103: 00000100:00100000:2.0:1782239780.891527:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239780.891564:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758896256 00000100:00100000:2.0:1782239780.891569:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758896256 00000100:00100000:2.0:1782239780.891607:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782239780.891614:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+10:3306:x1868813758896256:12345-0@lo:103: 00010000:00010000:2.0:1782239780.891636:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782239780.891651:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb5c2a45e00/0x8c5345f1c1ec4a95 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8c5345f1c1ec4a8e expref: 10 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239780.891678:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782239780.891707:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+9:3306:x1868813758896256:12345-0@lo:103: Request processed in 94us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239780.891715:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782239780.891786:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5dee25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3306:1868813758896256:0@lo:103: 00000100:00100000:3.0:1782239780.891982:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758896128 00000100:00100000:3.0:1782239780.891989:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758896128 00000100:00100000:3.0:1782239780.892010:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1782239780.892017:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d1bacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+9:6585:x1868813758896128:12345-0@lo:101: 00010000:00010000:3.0:1782239780.892028:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782239780.892040:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb5c2a45000/0x8c5345f1c1ec4aa3 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c5345f1c1ec4a9c expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239780.892061:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb5c2a45000/0x8c5345f1c1ec4aa3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4a9c expref: 10 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239780.892073:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb5c2a45000/0x8c5345f1c1ec4aa3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4a9c expref: 10 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239780.892080:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5c2a45000, rc 0) 00000100:00100000:3.0:1782239780.892122:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d1bacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+10:6585:x1868813758896128:12345-0@lo:101: Request processed in 105us (974us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239780.892127:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1782239780.892231:0:6585:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f48c0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:6585:1868813758896128:0@lo:101: 00010000:00010000:2.0:1782239780.892246:0:6585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff9bb602044800/0x8c5345f1c1ec4a9c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4aa3 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239780.892254:0:6585:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff9bb602044800/0x8c5345f1c1ec4a9c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c5345f1c1ec4aa3 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782239780.892269:0:6585:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1782239780.892284:0:6585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb602044800/0x8c5345f1c1ec4a9c lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4aa3 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239780.892292:0:6585:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff9bb602044800/0x8c5345f1c1ec4a9c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4aa3 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782239780.892300:0:6585:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1782239780.892304:0:6585:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1782239780.892310:0:6585:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1782239780.892313:0:6585:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1782239780.892329:0:6585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb602045400/0x8c5345f1c1ec4aaa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239780.892336:0:6585:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: ffff9bb602045400/0x8c5345f1c1ec4aaa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239780.892361:0:6585:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff9bb602045400/0x8c5345f1c1ec4aaa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239780.892375:0:6585:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f48c0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:6585:1868813758896384:0@lo:101: 00000100:00100000:2.0:1782239780.892402:0:6585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239780.892467:0:6585:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5d135c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782239780.892538:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758896384 00000100:00100000:0.0:1782239780.892544:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758896384 00000100:00100000:1.0:1782239780.892588:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1782239780.892604:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d1bac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+10:6585:x1868813758896384:12345-0@lo:101: 00010000:00010000:1.0:1782239780.892612:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782239780.892633:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb5c1676e00/0x8c5345f1c1ec4ab1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c5345f1c1ec4aaa expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239780.892649:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb5c1676e00/0x8c5345f1c1ec4ab1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4aaa expref: 11 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239780.892657:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb5c1676e00/0x8c5345f1c1ec4ab1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4aaa expref: 11 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239780.892664:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5c1676e00, rc 0) 00000100:00100000:1.0:1782239780.892700:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d1bac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+11:6585:x1868813758896384:12345-0@lo:101: Request processed in 97us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239780.892706:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1782239780.892845:0:6585:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f48c0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:6585:1868813758896384:0@lo:101: 00010000:00010000:2.0:1782239780.892857:0:6585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff9bb602045400/0x8c5345f1c1ec4aaa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4ab1 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239780.892864:0:6585:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff9bb602045400/0x8c5345f1c1ec4aaa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c5345f1c1ec4ab1 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239780.892962:0:6585:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f48c0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:6585:1868813758896512:0@lo:501: 00000100:00100000:2.0:1782239780.892989:0:6585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239780.893015:0:6585:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5d135c0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782239780.893062:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758896512 00000100:00100000:1.0:1782239780.893067:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758896512 00000100:00100000:1.0:1782239780.893098:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1782239780.893106:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d1bafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+11:6585:x1868813758896512:12345-0@lo:501: 00000100:00100000:1.0:1782239780.893459:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d1bafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+11:6585:x1868813758896512:12345-0@lo:501: Request processed in 352us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239780.893466:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1782239780.893525:0:6585:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f48c0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:6585:1868813758896512:0@lo:501: 00000100:00100000:2.0:1782239780.893557:0:6585:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f48c0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:6585:1868813758896640:0@lo:503: 00000100:00100000:2.0:1782239780.893598:0:6585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239780.893711:0:6585:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5d135c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782239780.893821:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758896640 00000100:00100000:0.0:1782239780.893826:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758896640 00000100:00100000:1.0:1782239780.893930:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1782239780.893939:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d1baf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+11:6585:x1868813758896640:12345-0@lo:503: 00000100:00100000:1.0:1782239780.894171:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d1baf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+11:6585:x1868813758896640:12345-0@lo:503: Request processed in 232us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239780.894178:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1782239780.894254:0:6585:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f48c0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:6585:1868813758896640:0@lo:503: 00000040:00080000:2.0:1782239780.894610:0:6585:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1782239780.895849:0:6585:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f48c0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:6585:1868813758896768:0@lo:502: 00000100:00100000:2.0:1782239780.895925:0:6585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239780.896063:0:6585:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5d135c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782239780.896148:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758896768 00000100:00100000:3.0:1782239780.896157:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758896768 00000100:00100000:3.0:1782239780.896206:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1782239780.896215:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d1bae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+11:6585:x1868813758896768:12345-0@lo:502: 00000100:00100000:3.0:1782239780.896447:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d1bae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+11:6585:x1868813758896768:12345-0@lo:502: Request processed in 232us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239780.896454:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1782239780.896556:0:6585:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f48c0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:6585:1868813758896768:0@lo:502: 00000040:00080000:2.0:1782239780.896913:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1782239780.896973:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1782239780.897023:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1782239780.897072:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1782239780.897108:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1782239780.897141:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1782239780.897172:0:6585:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f48c0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:6585:1868813758896896:0@lo:502: 00000100:00100000:2.0:1782239780.897221:0:6585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239780.897247:0:6585:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5d135c0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782239780.897271:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758896896 00000100:00100000:2.0:1782239780.897276:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758896896 00000100:00100000:2.0:1782239780.897307:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1782239780.897314:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d1baf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+11:6585:x1868813758896896:12345-0@lo:502: 00000100:00100000:2.0:1782239780.897480:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d1baf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+11:6585:x1868813758896896:12345-0@lo:502: Request processed in 165us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239780.897487:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1782239780.897538:0:6585:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f48c0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:6585:1868813758896896:0@lo:502: 00000040:00080000:2.0:1782239780.897610:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1782239780.897619:0:6585:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:3.0:1782239780.898712:0:6604:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1782239780.898725:0:6604:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1782239780.898733:0:6604:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782239780.898735:0:6604:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1782239780.898919:0:6604:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1782239780.898951:0:6604:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9bb5f78a3380) 00000020:00000080:3.0:1782239780.898978:0:6604:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:3.0:1782239780.898985:0:6604:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1782239780.899050:0:6604:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bb5c8863000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1782239780.899059:0:6604:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1782239780.899065:0:6604:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x8c5345f1c1ec4abf 00010000:00010000:3.0:1782239780.904217:0:6604:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:3.0:1782239780.904744:0:6604:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1782239780.909211:0:6604:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1782239780.910044:0:6604:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1782239780.919243:0:6604:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1782239780.921196:0:6604:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1782239780.923615:0:6604:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1782239780.923695:0:6604:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782239780.923704:0:6604:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782239780.923706:0:6604:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1782239780.923710:0:6604:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782239780.923715:0:6604:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782239780.923716:0:6604:0:(obd_config.c:1561:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:3.0:1782239780.923719:0:6604:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1782239780.923722:0:6604:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1782239780.923832:0:6604:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782239780.923835:0:6604:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782239780.923837:0:6604:0:(obd_config.c:1561:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:3.0:1782239780.923840:0:6604:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1782239780.924088:0:6585:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:0.0:1782239780.924119:0:6585:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1782239780.924145:0:6585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb602045400/0x8c5345f1c1ec4aaa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4ab1 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239780.924159:0:6585:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff9bb602045400/0x8c5345f1c1ec4aaa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4ab1 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782239780.924167:0:6585:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9bb5c8863000 from 1 10000000:01000000:0.0:1782239780.924170:0:6585:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1782239780.924225:0:6585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5c0030a00/0x8c5345f1c1ec4ac6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239780.924234:0:6585:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: ffff9bb5c0030a00/0x8c5345f1c1ec4ac6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239780.924247:0:6585:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff9bb5c0030a00/0x8c5345f1c1ec4ac6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782239780.924277:0:6585:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5dee24700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:6585:1868813758897024:0@lo:101: 00000100:00100000:0.0:1782239780.924384:0:6585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239780.924456:0:6585:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5d0ddeb40 going to sleep for 11 seconds 00000100:00100000:1.0:1782239780.924547:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758897024 00000100:00100000:1.0:1782239780.924568:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758897024 00000100:00100000:1.0:1782239780.924634:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1782239780.924645:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d1bae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+11:6585:x1868813758897024:12345-0@lo:101: 00010000:00010000:1.0:1782239780.924661:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782239780.924676:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb5c1677e00/0x8c5345f1c1ec4acd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c5345f1c1ec4ac6 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239780.924706:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb5c1677e00/0x8c5345f1c1ec4acd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4ac6 expref: 12 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239780.924718:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb5c1677e00/0x8c5345f1c1ec4acd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4ac6 expref: 12 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239780.924729:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5c1677e00, rc 0) 00000100:00100000:1.0:1782239780.924807:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d1bae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+12:6585:x1868813758897024:12345-0@lo:101: Request processed in 163us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239780.924815:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1782239780.924875:0:6585:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5dee24700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:6585:1868813758897024:0@lo:101: 00010000:00010000:1.0:1782239780.924892:0:6585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff9bb5c0030a00/0x8c5345f1c1ec4ac6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4acd expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239780.924903:0:6585:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff9bb5c0030a00/0x8c5345f1c1ec4ac6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c5345f1c1ec4acd expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239780.925041:0:6585:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb6018cc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:6585:1868813758897152:0@lo:501: 00000100:00100000:1.0:1782239780.925073:0:6585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239780.925104:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758897152 00000100:00100000:1.0:1782239780.925108:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758897152 00000100:00100000:1.0:1782239780.925133:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1782239780.925148:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5decbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+12:6585:x1868813758897152:12345-0@lo:501: 00000100:00100000:1.0:1782239780.925445:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5decbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+12:6585:x1868813758897152:12345-0@lo:501: Request processed in 298us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239780.925453:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1782239780.925483:0:6585:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5fc1b3540 going to sleep for 11 seconds 00000100:00100000:1.0:1782239780.925497:0:6585:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb6018cc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:6585:1868813758897152:0@lo:501: 00000100:00100000:1.0:1782239780.925530:0:6585:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb6018cc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:6585:1868813758897280:0@lo:503: 00000100:00100000:1.0:1782239780.925573:0:6585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239780.925588:0:6585:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5fc1b3540 going to sleep for 11 seconds 00000100:00100000:1.0:1782239780.925602:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758897280 00000100:00100000:1.0:1782239780.925606:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758897280 00000100:00100000:1.0:1782239780.925625:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1782239780.925630:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5decbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+12:6585:x1868813758897280:12345-0@lo:503: 00000100:00100000:1.0:1782239780.926004:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5decbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+12:6585:x1868813758897280:12345-0@lo:503: Request processed in 372us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239780.926011:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1782239780.926058:0:6585:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb6018cc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:6585:1868813758897280:0@lo:503: 00000040:00080000:1.0:1782239780.926410:0:6585:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1782239780.926506:0:6585:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb6018cc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:6585:1868813758897408:0@lo:502: 00000100:00100000:1.0:1782239780.926550:0:6585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239780.926569:0:6585:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5d1f15300 going to sleep for 11 seconds 00000100:00100000:1.0:1782239780.926587:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758897408 00000100:00100000:1.0:1782239780.926593:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758897408 00000100:00100000:1.0:1782239780.926617:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1782239780.926624:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5decbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+12:6585:x1868813758897408:12345-0@lo:502: 00000100:00100000:1.0:1782239780.926823:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5decbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+12:6585:x1868813758897408:12345-0@lo:502: Request processed in 198us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239780.926837:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1782239780.926882:0:6585:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb6018cc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:6585:1868813758897408:0@lo:502: 00000040:00080000:1.0:1782239780.927143:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1782239780.927193:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1782239780.927215:0:6585:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb6018cc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:6585:1868813758897536:0@lo:502: 00000100:00100000:1.0:1782239780.927251:0:6585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239780.927275:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758897536 00000100:00100000:1.0:1782239780.927278:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758897536 00000100:00100000:1.0:1782239780.927297:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1782239780.927302:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5decbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+12:6585:x1868813758897536:12345-0@lo:502: 00000100:00100000:1.0:1782239780.928067:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5decbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+12:6585:x1868813758897536:12345-0@lo:502: Request processed in 761us (813us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239780.928076:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1782239780.928123:0:6585:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5d1f15300 going to sleep for 11 seconds 00000100:00100000:1.0:1782239780.928139:0:6585:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb6018cc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:6585:1868813758897536:0@lo:502: 00000040:00080000:1.0:1782239780.928248:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1782239780.928259:0:6585:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1782239780.931186:0:6607:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782239780.931204:0:6607:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782239780.931207:0:6607:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1782239780.931215:0:6607:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bb5c8863000 00000020:00000080:3.0:1782239780.931218:0:6607:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1782239780.931240:0:6607:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782239780.931244:0:6607:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782239780.931255:0:6607:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1782239780.931265:0:6607:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1782239780.931448:0:6585:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1782239780.931478:0:6585:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1782239780.931508:0:6585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5c0030a00/0x8c5345f1c1ec4ac6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4acd expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239780.931523:0:6585:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff9bb5c0030a00/0x8c5345f1c1ec4ac6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4acd expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782239780.931571:0:6585:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1782239780.931574:0:6585:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9bb5c8863000 10000000:01000000:1.0:1782239780.931584:0:6585:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9bb5c8863000 10000000:01000000:1.0:1782239780.931590:0:6585:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1782239780.931598:0:6585:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9bb5c8863000 from 1 10000000:01000000:1.0:1782239780.931601:0:6585:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1782239780.931854:0:6585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5c1677000/0x8c5345f1c1ec4ad4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239780.931864:0:6585:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: ffff9bb5c1677000/0x8c5345f1c1ec4ad4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239780.931876:0:6585:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff9bb5c1677000/0x8c5345f1c1ec4ad4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239780.931903:0:6585:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb6018cc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:6585:1868813758897664:0@lo:101: 00000100:00100000:1.0:1782239780.932012:0:6585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239780.932107:0:6585:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5d1f150c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782239780.932215:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758897664 00000100:00100000:0.0:1782239780.932224:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758897664 00000100:00100000:0.0:1782239780.932282:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1782239780.932292:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5decbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+12:6585:x1868813758897664:12345-0@lo:101: 00010000:00010000:0.0:1782239780.932309:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782239780.932324:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb5c0031a00/0x8c5345f1c1ec4adb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c5345f1c1ec4ad4 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239780.932375:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb5c0031a00/0x8c5345f1c1ec4adb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4ad4 expref: 13 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239780.932386:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb5c0031a00/0x8c5345f1c1ec4adb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4ad4 expref: 13 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239780.932396:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5c0031a00, rc 0) 00000100:00100000:0.0:1782239780.932442:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5decbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+13:6585:x1868813758897664:12345-0@lo:101: Request processed in 151us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239780.932450:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1782239780.932616:0:6585:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb6018cc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:6585:1868813758897664:0@lo:101: 00010000:00010000:1.0:1782239780.932699:0:6585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff9bb5c1677000/0x8c5345f1c1ec4ad4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4adb expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239780.932708:0:6585:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff9bb5c1677000/0x8c5345f1c1ec4ad4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c5345f1c1ec4adb expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239780.932841:0:6585:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb6018cc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:6585:1868813758897792:0@lo:501: 00000100:00100000:1.0:1782239780.932872:0:6585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239780.932895:0:6585:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5d1f150c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782239780.932976:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758897792 00000100:00100000:1.0:1782239780.932981:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758897792 00000100:00100000:1.0:1782239780.933013:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1782239780.933020:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5decbc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+13:6585:x1868813758897792:12345-0@lo:501: 00000100:00100000:1.0:1782239780.933317:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5decbc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+13:6585:x1868813758897792:12345-0@lo:501: Request processed in 296us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239780.933324:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1782239780.933593:0:6585:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb6018cc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:6585:1868813758897792:0@lo:501: 00000100:00100000:1.0:1782239780.933866:0:6585:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb6018cc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:6585:1868813758897920:0@lo:503: 00000100:00100000:1.0:1782239780.933932:0:6585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239780.933961:0:6585:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5d1f150c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782239780.934104:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758897920 00000100:00100000:0.0:1782239780.934110:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758897920 00000100:00100000:0.0:1782239780.934146:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1782239780.934154:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5decbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+13:6585:x1868813758897920:12345-0@lo:503: 00000100:00100000:0.0:1782239780.934333:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5decbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+13:6585:x1868813758897920:12345-0@lo:503: Request processed in 179us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239780.934340:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1782239780.934500:0:6585:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb6018cc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:6585:1868813758897920:0@lo:503: 00000040:00080000:1.0:1782239780.935174:0:6585:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1782239780.935256:0:6585:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb6018cc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:6585:1868813758898048:0@lo:502: 00000100:00100000:1.0:1782239780.935311:0:6585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239780.935358:0:6585:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5d1f150c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782239780.935418:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758898048 00000100:00100000:2.0:1782239780.935425:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758898048 00000100:00100000:2.0:1782239780.935470:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1782239780.935479:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5decbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+13:6585:x1868813758898048:12345-0@lo:502: 00000100:00100000:2.0:1782239780.935705:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5decbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+13:6585:x1868813758898048:12345-0@lo:502: Request processed in 227us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239780.935712:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1782239780.935935:0:6585:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb6018cc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:6585:1868813758898048:0@lo:502: 00000040:00080000:1.0:1782239780.936227:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1782239780.936282:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1782239780.936329:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1782239780.936392:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1782239780.936433:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1782239780.936479:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1782239780.936514:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1782239780.936547:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1782239780.936594:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1782239780.936645:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1782239780.936714:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1782239780.936799:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1782239780.936836:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1782239780.936864:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1782239780.936931:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1782239780.936971:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1782239780.937003:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1782239780.937046:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1782239780.937086:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1782239780.937114:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1782239780.937150:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1782239780.937179:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1782239780.937207:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1782239780.937255:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1782239780.937290:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1782239780.937323:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1782239780.937383:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1782239780.937418:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:1.0:1782239780.937467:0:6585:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb6018cc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:6585:1868813758898176:0@lo:502: 00000100:00100000:1.0:1782239780.937547:0:6585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239780.937590:0:6585:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5d1f150c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782239780.937786:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758898176 00000100:00100000:0.0:1782239780.937794:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758898176 00000100:00100000:0.0:1782239780.937852:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1782239780.937862:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5decbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+13:6585:x1868813758898176:12345-0@lo:502: 00000100:00100000:0.0:1782239780.938141:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5decbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+13:6585:x1868813758898176:12345-0@lo:502: Request processed in 277us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239780.938150:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1782239780.939183:0:6585:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb6018cc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:6585:1868813758898176:0@lo:502: 00000040:00080000:1.0:1782239780.939325:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1782239780.939340:0:6585:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:2.0:1782239780.940467:0:6609:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1782239780.940695:0:6609:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9bb5ded04d40) 00000020:00000080:2.0:1782239780.940725:0:6609:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:2.0:1782239780.941571:0:6609:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bb5c8863000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1782239780.941578:0:6609:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bb5c8863000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1782239780.941581:0:6609:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9bb5c8863000 3 00010000:00080000:2.0:1782239780.941785:0:6609:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bb5f7b6a800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.132@tcp at head 00010000:00010000:1.0:1782239780.946385:0:6609:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:1.0:1782239780.946543:0:6609:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1782239780.946597:0:6609:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1782239780.946615:0:6609:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x8c5345f1c1ec4ae9 00000100:00080000:1.0:1782239780.946629:0:6609:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1782239780.946637:0:6609:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bb5f7b6a800 using connection 192.168.203.132@tcp/0@lo 00000100:00100000:1.0:1782239780.946681:0:6609:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bb6018cc380 x1868813758898304/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1782239780.946720:0:6609:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1782239780.946825:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb6018cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1868813758898304:0@lo:38: 00000100:00100000:3.0:1782239780.946929:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239780.947005:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758898304 00000100:00100000:3.0:1782239780.947012:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758898304 00000100:00100000:3.0:1782239780.947052:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1782239780.947061:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb601358000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3303:x1868813758898304:12345-0@lo:38: 00010000:00080000:3.0:1782239780.947090:0:5792:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 160 last 0 00000020:00000080:3.0:1782239780.947131:0:5792:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x8c5345f1c1ec4af0 00000004:00100000:3.0:1782239780.947152:0:5792:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:2.0:1782239780.947203:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f48c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1868813758898432:0@lo:400: 00000100:00100000:2.0:1782239780.947239:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239780.947284:0:5791:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1782239780.947295:0:5791:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00080000:3.0:1782239780.947326:0:5792:0:(import.c:65:import_set_state_nolock()) ffff9bb5f7afb000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782239780.947409:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb601358000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1868813758898304:12345-0@lo:38: Request processed in 346us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239780.947419:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1782239780.947438:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758898432 00000100:00100000:3.0:1782239780.947442:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758898432 00000100:00100000:3.0:1782239780.947468:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1782239780.947473:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1868813758898432:12345-0@lo:400: 00000100:00100000:3.0:1782239780.947522:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1868813758898432:12345-0@lo:400: Request processed in 48us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239780.947530:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1782239780.947575:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9bb6018cc380 x1868813758898304/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782239790 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782239780.947587:0:3303:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1782239780.947596:0:3303:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00010000:00080000:2.0:1782239780.947598:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9bb5f48c0700 x1868813758898432/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782239796 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1782239780.947606:0:3303:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00100000:2.0:1782239780.947612:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f48c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1868813758898432:0@lo:400: 00000100:00080000:3.0:1782239780.947622:0:3303:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1782239780.947626:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9bb5f7b6a800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1782239780.947637:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb6018cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1868813758898304:0@lo:38: 00000040:00080000:1.0:1782239780.954075:0:6609:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:1.0:1782239780.954176:0:6585:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:1.0:1782239780.954203:0:6585:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1782239780.954234:0:6585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5c1677000/0x8c5345f1c1ec4ad4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4adb expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239780.954249:0:6585:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff9bb5c1677000/0x8c5345f1c1ec4ad4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4adb expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1782239780.954310:0:6585:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1782239780.954313:0:6585:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1782239780.954315:0:6585:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782239780.954316:0:6585:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1782239780.954317:0:6585:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782239780.954319:0:6585:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782239780.954321:0:6585:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1782239780.954322:0:6585:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1782239780.954324:0:6585:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1782239780.954326:0:6585:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782239780.954327:0:6585:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1782239780.954332:0:6585:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:1.0:1782239780.954335:0:6585:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1782239780.954337:0:6585:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1782239780.954338:0:6585:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782239780.954339:0:6585:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1782239780.954340:0:6585:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782239780.954341:0:6585:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782239780.954342:0:6585:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1782239780.954343:0:6585:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1782239780.954344:0:6585:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1782239780.954345:0:6585:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782239780.954346:0:6585:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1782239780.954392:0:6585:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1782239780.954417:0:6585:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb6018cc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:6585:1868813758898560:0@lo:253: 00000100:00100000:1.0:1782239780.954510:0:6585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239780.954567:0:6585:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5d1f15300 going to sleep for 11 seconds 00000100:00100000:0.0:1782239780.954805:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758898560 00000100:00100000:0.0:1782239780.954816:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758898560 00000100:00100000:0.0:1782239780.954864:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1782239780.954884:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5decbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+13:6585:x1868813758898560:12345-0@lo:253: 20000000:01000000:0.0:1782239780.954992:0:5784:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1782239780.955012:0:5784:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1782239780.994259:0:5784:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1782239780.994284:0:5784:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1782239780.994492:0:5806:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1782239780.994499:0:5806:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1782239780.994531:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bb5c1677800/0x8c5345f1c1ec4af7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239780.994555:0:5806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bb5c1677c00/0x8c5345f1c1ec4a56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4a4f expref: 13 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239780.994564:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bb5c1677800/0x8c5345f1c1ec4af7 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239780.994728:0:5806:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bb5c1677c00/0x8c5345f1c1ec4a56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8c5345f1c1ec4a4f expref: 13 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239780.994789:0:5806:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bb5c1677c00/0x8c5345f1c1ec4a56 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8c5345f1c1ec4a4f expref: 13 pid: 5785 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239780.994809:0:5806:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb6018ce300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5806:1868813758898688:0@lo:104: 00000100:00100000:1.0:1782239780.994899:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239780.995320:0:5806:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5d1f15e40 going to sleep for 11 seconds 00000100:00100000:3.0:1782239781.004237:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758898688 00000100:00100000:3.0:1782239781.004263:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758898688 00000100:00100000:3.0:1782239781.004358:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1782239781.004371:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb6018cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+3:5806:x1868813758898688:12345-0@lo:104: 00010000:00010000:3.0:1782239781.004395:0:5773:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.132@tcp lock: ffff9bb602044a00/0x8c5345f1c1ec4a4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c5345f1c1ec4a56 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239781.004525:0:5773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782239781.004531:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb6018cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+3:5806:x1868813758898688:12345-0@lo:104: Request processed in 163us (9633us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239781.004539:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1782239781.004562:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782239781.004569:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.132@tcp lock: ffff9bb602044a00/0x8c5345f1c1ec4a4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c5345f1c1ec4a56 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239781.004577:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb602044a00 already unused, calling callback (ffffffffc1d0cc20) 10000000:00010000:3.0:1782239781.004582:0:5778:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.132@tcp lock: ffff9bb602044a00/0x8c5345f1c1ec4a4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8c5345f1c1ec4a56 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239781.004591:0:5778:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.132@tcp lock: ffff9bb602044a00/0x8c5345f1c1ec4a4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8c5345f1c1ec4a56 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782239781.004598:0:5778:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.132@tcp lock: ffff9bb602044a00/0x8c5345f1c1ec4a4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8c5345f1c1ec4a56 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239781.004620:0:5806:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb6018ce300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5806:1868813758898688:0@lo:104: 00010000:00010000:2.0:1782239781.004652:0:5806:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bb5c1677800/0x8c5345f1c1ec4af7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782239781.004909:0:5778:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1782239781.004957:0:5778:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.132@tcp lock: ffff9bb602044a00/0x8c5345f1c1ec4a4f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c5345f1c1ec4a56 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239781.004963:0:5778:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782239781.004987:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.132@tcp lock: ffff9bb602044a00/0x8c5345f1c1ec4a4f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c5345f1c1ec4a56 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239781.004995:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.132@tcp lock: ffff9bb602044a00/0x8c5345f1c1ec4a4f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c5345f1c1ec4a56 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239781.005015:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782239781.005017:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782239781.005019:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782239781.005195:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb601359180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3304:1868813758898816:0@lo:103: 00000100:00100000:3.0:1782239781.005253:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239781.005334:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758898816 00000100:00100000:3.0:1782239781.005340:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758898816 00010000:00010000:3.0:1782239781.005376:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bb5c1677c00/0x8c5345f1c1ec4a56 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c5345f1c1ec4a4f expref: 14 pid: 5785 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239781.005404:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1782239781.005412:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d810d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+14:3304:x1868813758898816:12345-0@lo:103: 00010000:00010000:3.0:1782239781.005425:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782239781.005430:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bb5c1677c00/0x8c5345f1c1ec4a56 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c5345f1c1ec4a4f expref: 14 pid: 5785 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239781.005442:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bb5c1677c00/0x8c5345f1c1ec4a56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8c5345f1c1ec4a4f expref: 14 pid: 5785 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239781.005469:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb5c1677c00/0x8c5345f1c1ec4a56 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8c5345f1c1ec4a4f expref: 14 pid: 5785 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239781.005487:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bb5c1677800/0x8c5345f1c1ec4af7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239781.005497:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb5c1677800/0x8c5345f1c1ec4af7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1782239781.005514:0:5776:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.011015872s 00010000:00010000:3.0:1782239781.005519:0:5776:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bb5c1677800/0x8c5345f1c1ec4af7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239781.005526:0:5776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bb5c1677800/0x8c5345f1c1ec4af7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239781.005533:0:5776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bb5c1677800/0x8c5345f1c1ec4af7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239781.005541:0:5776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bb5c1677800/0x8c5345f1c1ec4af7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239781.005547:0:5776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5c1677800 already unused, calling callback (ffffffffc1728ce0) 00010000:00010000:3.0:1782239781.005551:0:5776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bb5c1677800/0x8c5345f1c1ec4af7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239781.005561:0:5776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bb5c1677800/0x8c5345f1c1ec4af7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239781.005576:0:5776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bb5c1677800/0x8c5345f1c1ec4af7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239781.005610:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782239781.005842:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d810d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+13:3304:x1868813758898816:12345-0@lo:103: Request processed in 429us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239781.005850:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1782239781.005859:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb601359180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3304:1868813758898816:0@lo:103: 00010000:00010000:3.0:1782239781.005905:0:5806:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bb5c1677800/0x8c5345f1c1ec4af7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239781.005914:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bb5c1677800/0x8c5345f1c1ec4af7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239781.005920:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb5c1677800/0x8c5345f1c1ec4af7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239781.011042:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5decbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+12:6585:x1868813758898560:12345-0@lo:253: Request processed in 56147us (56519us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239781.011142:0:6585:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb6018cc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:6585:1868813758898560:0@lo:253: 10000000:01000000:1.0:1782239781.011165:0:6585:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1782239781.011169:0:6585:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1782239781.011171:0:6585:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1782239781.011172:0:6585:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782239781.011173:0:6585:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1782239781.011174:0:6585:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782239781.011176:0:6585:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782239781.011177:0:6585:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1782239781.011179:0:6585:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1782239781.011180:0:6585:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1782239781.011183:0:6585:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782239781.011184:0:6585:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1782239781.011224:0:6585:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1782239781.011573:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00080000:10000000:1.0:1782239781.019922:0:6585:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1782239781.020165:0:6585:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1782239781.020432:0:6585:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1782239781.020584:0:6585:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1782239781.021414:0:6585:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1782239781.021737:0:6585:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1782239781.023324:0:6585:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:2.0:1782239781.094244:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1782239781.261198:0:6585:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1782239781.261208:0:6585:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1782239781.261248:0:6585:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1782239781.261339:0:6585:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.132@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1782239781.261371:0:6585:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1782239781.261410:0:6585:0:(super25.c:187:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1782239782.126108:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782239783.136295:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782239784.161838:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782239785.184027:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782239786.208497:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782239786.271010:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f48c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3305:1868813758898944:0@lo:400: 00000100:00100000:2.0:1782239786.271081:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239786.271141:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f48c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1868813758899072:0@lo:400: 00000100:00100000:2.0:1782239786.271175:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239786.271193:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782239786.271198:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f48c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1868813758899200:0@lo:400: 00000100:00100000:2.0:1782239786.271234:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239786.271265:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758898944 00000100:00100000:2.0:1782239786.271271:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758898944 00000100:00100000:2.0:1782239786.271324:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1782239786.271333:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5decbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+12:3305:x1868813758898944:12345-0@lo:400: 00000100:00100000:2.0:1782239786.271384:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5decbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+12:3305:x1868813758898944:12345-0@lo:400: Request processed in 51us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239786.271391:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1782239786.271422:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758899072 00000100:00100000:2.0:1782239786.271425:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758899072 00000100:00100000:2.0:1782239786.271448:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758899200 00000100:00100000:2.0:1782239786.271450:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758899200 00000100:00100000:2.0:1782239786.271475:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1782239786.271480:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1868813758899072:12345-0@lo:400: 00000100:00100000:2.0:1782239786.271513:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1868813758899072:12345-0@lo:400: Request processed in 33us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239786.271519:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1782239786.271529:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1782239786.271535:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1868813758899200:12345-0@lo:400: 00000100:00100000:2.0:1782239786.271561:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1868813758899200:12345-0@lo:400: Request processed in 26us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239786.271566:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1782239786.271624:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bb5f48c3800 x1868813758899200/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782239802 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782239786.271649:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f48c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1868813758899200:0@lo:400: 00010000:00080000:2.0:1782239786.271660:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bb5f48c1c00 x1868813758899072/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782239802 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782239786.271667:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f48c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1868813758899072:0@lo:400: 00000100:00100000:2.0:1782239786.271689:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f48c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3305:1868813758898944:0@lo:400: 00000100:00080000:0.0:1782239786.273528:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1782239787.234533:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782239787.438658:0:6954:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg332-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1782239788.255030:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1782239788.831220:0:5787:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1782239788.831225:0:5787:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9bb5c8415000 from 21 10000000:01000000:3.0:1782239788.831231:0:5787:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1782239788.831275:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a45600/0x8c5345f1c1ec4afe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239788.831287:0:5787:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a45600/0x8c5345f1c1ec4afe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239788.831309:0:5787:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a45600/0x8c5345f1c1ec4afe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239788.831333:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb601358a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758899328:0@lo:101: 00000100:00100000:3.0:1782239788.831416:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239788.831481:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c50a6000 going to sleep for 11 seconds 00000100:00100000:1.0:1782239788.831540:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758899328 00000100:00100000:1.0:1782239788.831548:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758899328 00000100:00100000:1.0:1782239788.831597:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1782239788.831606:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5decbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+12:5787:x1868813758899328:12345-0@lo:101: 00010000:00010000:1.0:1782239788.831619:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782239788.831631:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb5c1676000/0x8c5345f1c1ec4b05 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c5345f1c1ec4afe expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239788.831653:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb5c1676000/0x8c5345f1c1ec4b05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4afe expref: 13 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239788.831664:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb5c1676000/0x8c5345f1c1ec4b05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4afe expref: 13 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239788.831672:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5c1676000, rc 0) 00000100:00100000:1.0:1782239788.831709:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5decbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+13:5787:x1868813758899328:12345-0@lo:101: Request processed in 105us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239788.831716:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1782239788.832287:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb601358a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758899328:0@lo:101: 00010000:00010000:3.0:1782239788.832312:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a45600/0x8c5345f1c1ec4afe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4b05 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239788.832321:0:5787:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a45600/0x8c5345f1c1ec4afe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c5345f1c1ec4b05 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239788.832437:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb601358a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758899456:0@lo:501: 00000100:00100000:3.0:1782239788.832466:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239788.832500:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c50a6000 going to sleep for 11 seconds 00000100:00100000:2.0:1782239788.832590:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758899456 00000100:00100000:2.0:1782239788.832595:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758899456 00000100:00100000:2.0:1782239788.832624:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1782239788.832631:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5decbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+13:5787:x1868813758899456:12345-0@lo:501: 00000100:00100000:2.0:1782239788.833573:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5decbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+13:5787:x1868813758899456:12345-0@lo:501: Request processed in 938us (1102us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239788.833581:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1782239788.837484:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb601358a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758899456:0@lo:501: 00000100:00100000:1.0:1782239788.837553:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb6018cc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758899584:0@lo:503: 00000100:00100000:1.0:1782239788.837637:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239788.837684:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5d8007e40 going to sleep for 11 seconds 00000100:00100000:3.0:1782239788.839389:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758899584 00000100:00100000:3.0:1782239788.839403:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758899584 00000100:00100000:3.0:1782239788.839458:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1782239788.839467:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5decbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+13:5787:x1868813758899584:12345-0@lo:503: 00000100:00100000:3.0:1782239788.839874:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5decbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+13:5787:x1868813758899584:12345-0@lo:503: Request processed in 407us (2235us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239788.839882:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1782239788.840010:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb6018cc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758899584:0@lo:503: 00000100:00100000:1.0:1782239788.841442:0:7038:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb6018cc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:7038:1868813758899712:0@lo:502: 00000100:00100000:1.0:1782239788.841516:0:7038:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239788.841557:0:7038:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c86923c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782239788.841606:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758899712 00000100:00100000:2.0:1782239788.841613:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758899712 00000100:00100000:2.0:1782239788.841658:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1782239788.841666:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5decbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+13:7038:x1868813758899712:12345-0@lo:502: 00000100:00100000:2.0:1782239788.841980:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5decbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+13:7038:x1868813758899712:12345-0@lo:502: Request processed in 314us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239788.841989:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1782239788.842344:0:7038:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb6018cc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:7038:1868813758899712:0@lo:502: 00000100:00100000:1.0:1782239788.842394:0:7038:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb6018cc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:7038:1868813758899840:0@lo:502: 00000100:00100000:1.0:1782239788.842430:0:7038:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239788.842461:0:7038:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c86923c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782239788.842507:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758899840 00000100:00100000:2.0:1782239788.842512:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758899840 00000100:00100000:2.0:1782239788.842578:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1782239788.842587:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5decbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+13:7038:x1868813758899840:12345-0@lo:502: 00000100:00100000:2.0:1782239788.842820:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5decbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+13:7038:x1868813758899840:12345-0@lo:502: Request processed in 234us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239788.842835:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1782239788.842917:0:7038:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb6018cc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:7038:1868813758899840:0@lo:502: 00000040:00080000:1.0:1782239788.842936:0:7038:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:3.0:1782239788.843171:0:5787:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:3.0:1782239788.843191:0:5787:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1782239788.843200:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a45600/0x8c5345f1c1ec4afe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4b05 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239788.843210:0:5787:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a45600/0x8c5345f1c1ec4afe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4b05 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782239788.843219:0:5787:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1782239788.843227:0:5787:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9bb5c8415000 from 4 10000000:01000000:3.0:1782239788.843230:0:5787:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1782239788.843255:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a45200/0x8c5345f1c1ec4b0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239788.843264:0:5787:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a45200/0x8c5345f1c1ec4b0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239788.843272:0:5787:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a45200/0x8c5345f1c1ec4b0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239788.843285:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb60135ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758899968:0@lo:101: 00000100:00100000:3.0:1782239788.843326:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239788.843562:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c50a66c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782239788.843635:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758899968 00000100:00100000:0.0:1782239788.843640:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758899968 00000100:00100000:2.0:1782239788.843677:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1782239788.843686:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d0330050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+13:5787:x1868813758899968:12345-0@lo:101: 00010000:00010000:2.0:1782239788.843695:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782239788.843707:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb602045e00/0x8c5345f1c1ec4b13 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c5345f1c1ec4b0c expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239788.843727:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb602045e00/0x8c5345f1c1ec4b13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4b0c expref: 14 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239788.843737:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb602045e00/0x8c5345f1c1ec4b13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4b0c expref: 14 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239788.843744:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb602045e00, rc 0) 00000100:00100000:2.0:1782239788.843800:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d0330050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+14:5787:x1868813758899968:12345-0@lo:101: Request processed in 115us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239788.843806:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1782239788.843866:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb60135ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758899968:0@lo:101: 00010000:00010000:3.0:1782239788.843879:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a45200/0x8c5345f1c1ec4b0c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4b13 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239788.843889:0:5787:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a45200/0x8c5345f1c1ec4b0c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c5345f1c1ec4b13 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239788.843932:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb60135ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758900096:0@lo:256: 00000100:00100000:3.0:1782239788.843961:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239788.844201:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c50a66c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782239788.844235:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758900096 00000100:00100000:1.0:1782239788.844240:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758900096 00000100:00100000:1.0:1782239788.844260:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1782239788.844267:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d0330c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+14:5787:x1868813758900096:12345-0@lo:256: 20000000:01000000:1.0:1782239788.844280:0:5783:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1782239788.844307:0:5783:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1782239788.844310:0:5783:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1782239788.844402:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d0330c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+14:5787:x1868813758900096:12345-0@lo:256: Request processed in 135us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239788.844409:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1782239788.844476:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb60135ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758900096:0@lo:256: 10000000:01000000:3.0:1782239788.844517:0:5787:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1782239788.844522:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a45200/0x8c5345f1c1ec4b0c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4b13 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239788.844539:0:5787:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a45200/0x8c5345f1c1ec4b0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4b13 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782239788.844546:0:5787:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1782239788.844548:0:5787:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:3.0:1782239788.844550:0:5787:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1782239788.844579:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a45a00/0x8c5345f1c1ec4b1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239788.844586:0:5787:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a45a00/0x8c5345f1c1ec4b1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239788.844594:0:5787:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a45a00/0x8c5345f1c1ec4b1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239788.844606:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb60135ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758900224:0@lo:101: 00000100:00100000:3.0:1782239788.844630:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239788.844649:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c50a66c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782239788.844694:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758900224 00000100:00100000:1.0:1782239788.844703:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758900224 00000100:00100000:1.0:1782239788.844719:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1782239788.844724:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d0330450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+14:5787:x1868813758900224:12345-0@lo:101: 00010000:00010000:1.0:1782239788.844731:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782239788.844739:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb5c1676400/0x8c5345f1c1ec4b21 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c5345f1c1ec4b1a expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239788.844782:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb5c1676400/0x8c5345f1c1ec4b21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4b1a expref: 15 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239788.844791:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb5c1676400/0x8c5345f1c1ec4b21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4b1a expref: 15 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239788.844798:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5c1676400, rc 0) 00000100:00100000:1.0:1782239788.844822:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d0330450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+15:5787:x1868813758900224:12345-0@lo:101: Request processed in 97us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239788.844827:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1782239788.844934:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb60135ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758900224:0@lo:101: 00010000:00010000:3.0:1782239788.844945:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a45a00/0x8c5345f1c1ec4b1a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4b21 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239788.844953:0:5787:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a45a00/0x8c5345f1c1ec4b1a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c5345f1c1ec4b21 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239788.844993:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb60135ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758900352:0@lo:501: 00000100:00100000:3.0:1782239788.845017:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239788.845062:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c50a66c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782239788.845193:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758900352 00000100:00100000:1.0:1782239788.845198:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758900352 00000100:00100000:1.0:1782239788.845216:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1782239788.845221:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d0333c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+15:5787:x1868813758900352:12345-0@lo:501: 00000100:00100000:1.0:1782239788.845473:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d0333c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+15:5787:x1868813758900352:12345-0@lo:501: Request processed in 250us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239788.845479:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1782239788.845546:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb60135ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758900352:0@lo:501: 00000100:00100000:3.0:1782239788.845577:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb60135ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758900480:0@lo:503: 00000100:00100000:3.0:1782239788.845614:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239788.845635:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c50a66c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782239788.845683:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758900480 00000100:00100000:1.0:1782239788.845688:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758900480 00000100:00100000:1.0:1782239788.845705:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1782239788.845710:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d0333850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+15:5787:x1868813758900480:12345-0@lo:503: 00000100:00100000:1.0:1782239788.846040:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d0333850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+15:5787:x1868813758900480:12345-0@lo:503: Request processed in 328us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239788.846061:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1782239788.846224:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb60135ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758900480:0@lo:503: 00000100:00100000:3.0:1782239788.846663:0:7039:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb60135ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:7039:1868813758900608:0@lo:502: 00000100:00100000:3.0:1782239788.846705:0:7039:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239788.846735:0:7039:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c50a6300 going to sleep for 11 seconds 00000100:00100000:1.0:1782239788.846829:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758900608 00000100:00100000:1.0:1782239788.846834:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758900608 00000100:00100000:1.0:1782239788.846863:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1782239788.846870:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d0332050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+15:7039:x1868813758900608:12345-0@lo:502: 00000100:00100000:1.0:1782239788.847228:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d0332050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+15:7039:x1868813758900608:12345-0@lo:502: Request processed in 356us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239788.847236:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1782239788.849529:0:7039:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb60135ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:7039:1868813758900608:0@lo:502: 00000020:01000000:3.0:1782239788.849579:0:7039:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1782239788.849587:0:7039:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1782239788.849596:0:7039:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782239788.849598:0:7039:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1782239788.849603:0:7039:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1782239788.849607:0:7039:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.132@tcp to nid 0x20000c0a8cb84 (192.168.203.132@tcp) 00000020:01000000:3.0:1782239788.849631:0:7039:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1782239788.849634:0:7039:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1782239788.849650:0:7039:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9bb5f78a0000) 00000020:00000080:3.0:1782239788.849670:0:7039:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1782239788.849674:0:7039:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1782239788.849792:0:7039:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1782239788.849798:0:7039:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:3.0:1782239788.849805:0:7039:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8c5345f1c1ec4b2f 00010000:00080000:3.0:1782239788.849836:0:7039:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bb5fbba5000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.132@tcp at head 00010000:00010000:3.0:1782239788.854958:0:7039:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1782239788.970773:0:7039:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1782239788.970804:0:7039:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1782239788.971395:0:7039:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782239788.971584:0:7039:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782239788.971644:0:7039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1782239788.971703:0:7039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1782239788.972555:0:7048:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782239788.972560:0:7048:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1782239788.973589:0:7039:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1782239788.973600:0:7039:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1782239788.973633:0:7039:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1782239788.973651:0:7039:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8c5345f1c1ec4b36 00000100:00080000:2.0:1782239788.973661:0:7039:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1782239788.973667:0:7039:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9bb5fbba5000 using connection 192.168.203.132@tcp/0@lo 00000100:00100000:2.0:1782239788.973713:0:7039:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bb5f48c0700 x1868813758900736/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1782239788.973782:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f48c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1868813758900736:0@lo:8: 00000100:00100000:3.0:1782239788.973859:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1782239788.974000:0:7039:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1782239788.974056:0:7039:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782239788.974066:0:7039:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782239788.974068:0:7039:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1782239788.974072:0:7039:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782239788.974075:0:7039:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782239788.974076:0:7039:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:2.0:1782239788.974080:0:7039:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1782239788.974081:0:7039:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1782239788.974105:0:7039:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f48c1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:7039:1868813758900864:0@lo:502: 00000100:00100000:2.0:1782239788.974150:0:7039:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239788.974168:0:7039:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c50a6780 going to sleep for 11 seconds 00000100:00100000:2.0:1782239788.974220:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758900864 00000100:00100000:2.0:1782239788.974226:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758900864 00000100:00100000:2.0:1782239788.974258:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1782239788.974265:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d0333450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+15:7039:x1868813758900864:12345-0@lo:502: 00000100:00100000:2.0:1782239788.974513:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d0333450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+15:7039:x1868813758900864:12345-0@lo:502: Request processed in 247us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239788.974522:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1782239788.974566:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f48c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1868813758900992:0@lo:400: 00000100:00100000:2.0:1782239788.974597:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239788.974619:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782239788.974625:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f48c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1868813758901120:0@lo:400: 00000100:00100000:2.0:1782239788.974655:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239788.974709:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758900992 00000100:00100000:2.0:1782239788.974715:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758900992 00000100:00100000:2.0:1782239788.974738:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758901120 00000100:00100000:2.0:1782239788.974742:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758901120 00000100:00100000:2.0:1782239788.974789:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1782239788.974795:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1868813758900992:12345-0@lo:400: 00000100:00100000:2.0:1782239788.974831:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1868813758900992:12345-0@lo:400: Request processed in 36us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239788.974846:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1782239788.974858:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1782239788.974865:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1868813758901120:12345-0@lo:400: 00000100:00100000:2.0:1782239788.974895:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1868813758901120:12345-0@lo:400: Request processed in 31us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239788.974900:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1782239788.974922:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1782239788.974950:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bb5f48c2d80 x1868813758901120/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782239804 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782239788.974963:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f48c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1868813758901120:0@lo:400: 00010000:00080000:2.0:1782239788.974974:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bb5f48c3800 x1868813758900992/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782239804 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782239788.974983:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f48c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1868813758900992:0@lo:400: 00000100:00100000:2.0:1782239788.975010:0:7039:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f48c1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:7039:1868813758900864:0@lo:502: 00000020:01000000:2.0:1782239788.975034:0:7039:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782239788.975039:0:7039:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782239788.975040:0:7039:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:2.0:1782239788.975044:0:7039:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:2.0:1782239788.975150:0:5787:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:2.0:1782239788.975166:0:5787:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1782239788.975176:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a45a00/0x8c5345f1c1ec4b1a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4b21 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239788.975186:0:5787:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a45a00/0x8c5345f1c1ec4b1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4b21 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782239788.975207:0:5787:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1782239788.975210:0:5787:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff9bb5d1bd99c0 from 1 10000000:01000000:2.0:1782239788.975212:0:5787:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1782239788.975237:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb602045000/0x8c5345f1c1ec4b3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239788.975245:0:5787:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: ffff9bb602045000/0x8c5345f1c1ec4b3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239788.975254:0:5787:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff9bb602045000/0x8c5345f1c1ec4b3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239788.975268:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f48c1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758901248:0@lo:101: 00000100:00100000:2.0:1782239788.975308:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239788.975325:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c50a6780 going to sleep for 11 seconds 00000100:00100000:2.0:1782239788.975339:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758901248 00000100:00100000:2.0:1782239788.975342:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758901248 00000100:00100000:2.0:1782239788.975362:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1782239788.975369:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d0332450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+15:5787:x1868813758901248:12345-0@lo:101: 00010000:00010000:2.0:1782239788.975376:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782239788.975387:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb602044600/0x8c5345f1c1ec4b44 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c5345f1c1ec4b3d expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239788.975408:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb602044600/0x8c5345f1c1ec4b44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4b3d expref: 16 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239788.975418:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb602044600/0x8c5345f1c1ec4b44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4b3d expref: 16 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239788.975437:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb602044600, rc 0) 00000100:00100000:2.0:1782239788.975465:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d0332450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+16:5787:x1868813758901248:12345-0@lo:101: Request processed in 96us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239788.975471:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1782239788.975500:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f48c1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758901248:0@lo:101: 00010000:00010000:2.0:1782239788.975511:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff9bb602045000/0x8c5345f1c1ec4b3d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4b44 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239788.975520:0:5787:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff9bb602045000/0x8c5345f1c1ec4b3d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c5345f1c1ec4b44 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239788.975558:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f48c1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758901376:0@lo:501: 00000100:00100000:2.0:1782239788.975581:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239788.975595:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c50a6780 going to sleep for 11 seconds 00000100:00100000:2.0:1782239788.975606:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758901376 00000100:00100000:2.0:1782239788.975609:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758901376 00000100:00100000:2.0:1782239788.975626:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1782239788.975631:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5c886b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+16:5787:x1868813758901376:12345-0@lo:501: 00000100:00100000:2.0:1782239788.975863:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5c886b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+16:5787:x1868813758901376:12345-0@lo:501: Request processed in 231us (279us total) trans 0 rc -2/-2 00000100:00100000:2.0:1782239788.975869:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1782239788.975898:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f48c1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758901376:0@lo:501: 10000000:01000000:2.0:1782239788.975915:0:5787:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1782239788.975921:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb602045000/0x8c5345f1c1ec4b3d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4b44 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239788.975939:0:5787:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff9bb602045000/0x8c5345f1c1ec4b3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4b44 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239788.977125:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758900736 00000100:00100000:3.0:1782239788.977134:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758900736 00000100:00100000:3.0:1782239788.977168:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782239788.977175:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb60135ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3303:x1868813758900736:12345-0@lo:8: 00010000:00080000:3.0:1782239788.977199:0:6588:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 168 last 0 00000020:00000080:3.0:1782239788.977225:0:6588:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8c5345f1c1ec4b4b 00002000:00100000:3.0:1782239788.977261:0:6588:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9bb5f460d800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113653 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1782239788.977265:0:6588:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:3.0:1782239788.977269:0:6588:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1782239788.977388:0:6588:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1782239788.977524:0:6588:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1782239788.977550:0:6588:0:(import.c:65:import_set_state_nolock()) ffff9bb5f460e800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782239788.977622:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb60135ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3303:x1868813758900736:12345-0@lo:8: Request processed in 446us (3763us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239788.977629:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1782239788.977670:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bb5f48c0700 x1868813758900736/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1782239798 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782239788.978641:0:3303:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1782239788.978655:0:3303:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1782239788.978680:0:3303:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1782239788.978696:0:3303:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1782239788.978700:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9bb5fbba5000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1782239788.978720:0:3303:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1782239788.978727:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f48c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1868813758900736:0@lo:8: 00000004:00080000:0.0:1782239788.979097:0:7048:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1782239788.979198:0:7048:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 168051449239ns, next at 0ns, rc = 0 00000004:00080000:2.0:1782239789.078990:0:7049:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:2.0:1782239789.079033:0:7049:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f48c3800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7049:1868813758901632:0@lo:7: 00000100:00100000:2.0:1782239789.079142:0:7049:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239789.079201:0:7049:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5e8d3f480 going to sleep for 11 seconds 00000004:00080000:2.0:1782239789.079223:0:5812:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:2.0:1782239789.079283:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f48c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813758901504:0@lo:13: 00000100:00100000:2.0:1782239789.079322:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239789.079375:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758901504 00000100:00100000:2.0:1782239789.079384:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758901504 00000100:00100000:2.0:1782239789.079450:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782239789.079464:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1868813758901504:12345-0@lo:13: 00002000:00000024:2.0:1782239789.079508:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1782239789.079561:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1868813758901504:12345-0@lo:13: Request processed in 101us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239789.079569:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1782239789.079594:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1782239789.079630:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bb5f48c1c00 x1868813758901504/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782239805 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782239789.079652:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f48c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813758901504:0@lo:13: 00000100:00100000:1.0:1782239789.079901:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758901632 00000100:00100000:1.0:1782239789.079906:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758901632 00000100:00100000:1.0:1782239789.079935:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782239789.079943:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7049:x1868813758901632:12345-0@lo:7: 00002000:00080000:0.0:1782239789.086786:0:6590:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:0.0:1782239789.086797:0:6590:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:0.0:1782239789.086919:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7049:x1868813758901632:12345-0@lo:7: Request processed in 6971us (7772us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239789.086933:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1782239789.086949:0:7049:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bb5f48c3800 x1868813758901632/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1782239805 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782239789.086967:0:7049:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f48c3800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7049:1868813758901632:0@lo:7: 00000004:00080000:2.0:1782239789.086991:0:7049:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1782239789.087039:0:7049:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f48c3800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7049:1868813758901760:0@lo:5: 00000100:00100000:2.0:1782239789.087082:0:7049:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239789.087146:0:7049:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5e8d3f480 going to sleep for 11 seconds 00000100:00100000:0.0:1782239789.087511:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758901760 00000100:00100000:0.0:1782239789.087520:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758901760 00000100:00100000:0.0:1782239789.087610:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1782239789.087622:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7049:x1868813758901760:12345-0@lo:5: 00002000:00080000:0.0:1782239789.087654:0:6589:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1782239789.087659:0:6589:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1782239789.088078:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:7049:x1868813758901760:12345-0@lo:5: Request processed in 457us (994us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1782239789.088095:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1782239789.088171:0:7049:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bb5f48c3800 x1868813758901760/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1782239805 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782239789.088186:0:7049:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f48c3800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7049:1868813758901760:0@lo:5: 00000004:00080000:2.0:1782239789.088199:0:7049:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1782239789.088247:0:7049:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f48c2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7049:1868813758901888:0@lo:700: 00000100:00100000:2.0:1782239789.088281:0:7049:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239789.088317:0:7049:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5e8d3f480 going to sleep for 11 seconds 00000100:00100000:3.0:1782239789.088550:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758901888 00000100:00100000:3.0:1782239789.088556:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758901888 00000100:00100000:3.0:1782239789.088601:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782239789.088610:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7049:x1868813758901888:12345-0@lo:700: 00000100:00100000:3.0:1782239789.088642:0:6597:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb601359f80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6597:1868813758902016:0@lo:700: 00000100:00100000:3.0:1782239789.088675:0:6597:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239789.088695:0:6597:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5d1bb3240 going to sleep for 11 seconds 00000100:00100000:0.0:1782239789.088782:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758902016 00000100:00100000:0.0:1782239789.088786:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758902016 00000100:00100000:0.0:1782239789.088815:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782239789.088827:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb601359880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6597:x1868813758902016:12345-0@lo:700: 40000000:02000000:0.0:1782239789.134485:0:5797:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:1.0:1782239789.141260:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb601359880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6597:x1868813758902016:12345-0@lo:700: Request processed in 52427us (52578us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239789.141281:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1782239789.141381:0:6597:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bb601359f80 x1868813758902016/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1782239805 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782239789.141399:0:6597:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb601359f80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6597:1868813758902016:0@lo:700: 40000000:02000000:3.0:1782239789.141412:0:6597:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00080000:2.0:1782239789.194416:0:6614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:2.0:1782239789.194444:0:6614:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1782239789.194675:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7049:x1868813758901888:12345-0@lo:700: Request processed in 106062us (106388us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239789.194712:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1782239789.195041:0:7049:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bb5f48c2a00 x1868813758901888/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1782239805 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782239789.195055:0:7049:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1782239789.195075:0:7049:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f48c2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7049:1868813758901888:0@lo:700: 00000004:02000040:2.0:1782239789.219966:0:7049:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:3.0:1782239789.226200:0:7049:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb601359f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7049:1868813758902144:0@lo:5: 00000100:00100000:3.0:1782239789.226278:0:7049:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239789.226404:0:7049:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5d1bb3000 going to sleep for 11 seconds 00000100:00100000:1.0:1782239789.226544:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758902144 00000100:00100000:1.0:1782239789.226552:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758902144 00000100:00100000:1.0:1782239789.226677:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782239789.226686:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb60135b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7049:x1868813758902144:12345-0@lo:5: 00002000:00080000:1.0:1782239789.233551:0:6590:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1782239789.233576:0:6590:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:1.0:1782239789.238354:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb60135b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7049:x1868813758902144:12345-0@lo:5: Request processed in 11661us (12069us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1782239789.238367:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1782239789.238513:0:7049:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bb601359f80 x1868813758902144/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1782239805 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782239789.238534:0:7049:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb601359f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7049:1868813758902144:0@lo:5: 00000004:00080000:3.0:1782239789.238550:0:7049:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:3.0:1782239789.279707:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782239790.306066:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782239791.327029:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1782239792.198034:0:6614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:2.0:1782239792.351848:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782239793.376067:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782239794.399799:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782239794.465392:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5dee24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1868813758902272:0@lo:13: 00000100:00100000:0.0:1782239794.465493:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239794.467424:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5dee27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3304:1868813758902400:0@lo:400: 00000100:00100000:0.0:1782239794.467505:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239794.468512:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782239794.468534:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5dee26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1868813758902528:0@lo:400: 00000100:00100000:0.0:1782239794.468584:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239794.468636:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758902400 00000100:00100000:0.0:1782239794.468646:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758902400 00000100:00100000:0.0:1782239794.468699:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1782239794.468709:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5c886a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+16:3304:x1868813758902400:12345-0@lo:400: 00000100:00100000:0.0:1782239794.468791:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5c886a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+16:3304:x1868813758902400:12345-0@lo:400: Request processed in 83us (1285us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239794.468800:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1782239794.468855:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5dee27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3304:1868813758902400:0@lo:400: 00000100:00100000:0.0:1782239794.468876:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782239794.468884:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5dee25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1868813758902656:0@lo:400: 00000100:00100000:0.0:1782239794.468909:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239794.468937:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758902528 00000100:00100000:0.0:1782239794.468940:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758902528 00000100:00100000:0.0:1782239794.468960:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758902656 00000100:00100000:0.0:1782239794.468962:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758902656 00000100:00100000:0.0:1782239794.468997:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1782239794.469002:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5dee27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1868813758902528:12345-0@lo:400: 00000100:00100000:0.0:1782239794.469035:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5dee27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1868813758902528:12345-0@lo:400: Request processed in 32us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239794.469042:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1782239794.469052:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1782239794.469058:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5dee27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1868813758902656:12345-0@lo:400: 00000100:00100000:0.0:1782239794.469097:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5dee27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1868813758902656:12345-0@lo:400: Request processed in 40us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239794.469103:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1782239794.469120:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1782239794.469142:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bb5dee26680 x1868813758902528/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782239810 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782239794.469155:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5dee26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1868813758902528:0@lo:400: 00010000:00080000:0.0:1782239794.469171:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bb5dee25c00 x1868813758902656/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782239810 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782239794.469180:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5dee25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1868813758902656:0@lo:400: 00000100:00100000:2.0:1782239794.469364:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758902272 00000100:00100000:2.0:1782239794.469370:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758902272 00000100:00100000:2.0:1782239794.469412:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782239794.469419:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5dee27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1868813758902272:12345-0@lo:13: 00002000:00000024:2.0:1782239794.469456:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782239794.469508:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5dee27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1868813758902272:12345-0@lo:13: Request processed in 89us (4016us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239794.469514:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1782239794.471339:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1782239794.471432:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bb5dee24380 x1868813758902272/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782239810 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782239794.471445:0:3307:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1782239794.471476:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5dee24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1868813758902272:0@lo:13: 00010000:00010000:0.0:1782239795.427974:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782239796.447387:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782239797.475810:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1782239797.538461:0:7475:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:1.0:1782239797.538465:0:7475:0:(obd_mount.c:917:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1782239797.538606:0:7475:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9bb5eddbf000 00000020:01000004:1.0:1782239797.538621:0:7475:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1782239797.538633:0:7475:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1782239797.538645:0:7475:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9bb5d1bdb380) 00000020:00000080:1.0:1782239797.538660:0:7475:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1782239797.592885:0:7475:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1782239797.600037:0:7475:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1782239797.651983:0:7475:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1782239797.669364:0:7475:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1782239797.669401:0:7475:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1782239797.669475:0:7475:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1782239797.670237:0:7475:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1782239797.671401:0:7475:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1782239797.671415:0:7475:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1782239797.671429:0:7475:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x8c5345f1c1ec4b59 00000020:01000004:2.0:1782239797.671437:0:7475:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1782239797.671458:0:7475:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.203.132@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1782239797.671461:0:7475:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.132@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1782239797.671468:0:7475:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1782239797.671491:0:7475:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1782239797.671495:0:7475:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.132@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1782239797.718958:0:7475:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.132@tcp ctxt 0 is initialized 00000020:01000004:1.0:1782239797.719001:0:7475:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.132@tcp, index=0001, flags=0x20062 00000020:01000004:1.0:1782239797.719006:0:7475:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1782239797.719007:0:7475:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1782239797.719009:0:7475:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782239797.719010:0:7475:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1782239797.719011:0:7475:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782239797.719012:0:7475:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782239797.719014:0:7475:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1782239797.719015:0:7475:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1782239797.719017:0:7475:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1782239797.719019:0:7475:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782239797.719020:0:7475:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1782239797.719024:0:7475:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:1.0:1782239797.719026:0:7475:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1782239797.719027:0:7475:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1782239797.719029:0:7475:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782239797.719030:0:7475:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1782239797.719031:0:7475:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782239797.719032:0:7475:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782239797.719033:0:7475:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1782239797.719034:0:7475:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1782239797.719035:0:7475:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1782239797.719036:0:7475:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782239797.719037:0:7475:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1782239797.719073:0:7475:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1782239797.719094:0:7475:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb6018cc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:7475:1868813758902784:0@lo:253: 00000100:00100000:1.0:1782239797.719169:0:7475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239797.719259:0:7475:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5e8e800c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782239797.719309:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758902784 00000100:00100000:2.0:1782239797.719319:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758902784 00000100:00100000:2.0:1782239797.719377:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1782239797.719386:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5c8869850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+16:7475:x1868813758902784:12345-0@lo:253: 20000000:01000000:2.0:1782239797.719414:0:5783:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1782239797.719418:0:5783:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:2.0:1782239797.719422:0:5783:0:(mgs_llog.c:867:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:2.0:1782239797.719426:0:5783:0:(mgs_llog.c:3853:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:3.0:1782239797.723813:0:5783:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782239797.725954:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:3.0:1782239797.725987:0:5783:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:3.0:1782239797.726351:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:3.0:1782239797.726362:0:5783:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:3.0:1782239797.726398:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:3.0:1782239797.726453:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:3.0:1782239797.726950:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:3.0:1782239797.726975:0:5783:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.203.132@tcp 20000000:01000000:3.0:1782239797.726977:0:5783:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.203.132@tcp (null) (null) (null) 00000040:00080000:3.0:1782239797.727013:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:3.0:1782239797.727021:0:5783:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1782239797.727080:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:3.0:1782239797.727088:0:5783:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.132@tcp (null) (null) 00000040:00080000:3.0:1782239797.727121:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:3.0:1782239797.727131:0:5783:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1782239797.727162:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:3.0:1782239797.727252:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:3.0:1782239797.728018:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:3.0:1782239797.728036:0:5783:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.203.132@tcp 20000000:01000000:3.0:1782239797.728038:0:5783:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.203.132@tcp (null) (null) (null) 00000040:00080000:3.0:1782239797.728069:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:3.0:1782239797.728076:0:5783:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1782239797.728103:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:3.0:1782239797.728111:0:5783:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.132@tcp (null) (null) 00000040:00080000:3.0:1782239797.728137:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:3.0:1782239797.728144:0:5783:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1782239797.728182:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:3.0:1782239797.728219:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:3.0:1782239797.729354:0:5783:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:3.0:1782239797.729358:0:5783:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:3.0:1782239797.729364:0:5783:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1782239797.729365:0:5783:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1782239797.729368:0:5783:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1782239797.729382:0:5783:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1782239797.729384:0:5783:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1782239797.729430:0:5783:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1782239797.729433:0:5783:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1782239797.732669:0:7477:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 27 marker 14 1->4: lustre sys.timeout 20000000:01000000:1.0:1782239797.732820:0:7477:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 29 marker 14 2->4: lustre sys.timeout 00000040:00080000:1.0:1782239797.732886:0:7477:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:3.0:1782239797.733406:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:3.0:1782239797.733455:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:3.0:1782239797.733492:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:3.0:1782239797.733504:0:5783:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1782239797.733507:0:5783:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1782239797.739006:0:7478:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 22 marker 15 1->4: lustre sys.timeout 20000000:01000000:0.0:1782239797.739242:0:7478:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 24 marker 15 2->4: lustre sys.timeout 00000040:00080000:0.0:1782239797.739305:0:7478:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:3.0:1782239797.739677:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:3.0:1782239797.739714:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:3.0:1782239797.739807:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:3.0:1782239797.739820:0:5783:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1782239797.739822:0:5783:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:2.0:1782239797.744111:0:7479:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:3.0:1782239797.744412:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:3.0:1782239797.744460:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:3.0:1782239797.744547:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:3.0:1782239797.744562:0:5783:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1782239797.744564:0:5783:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1782239797.745777:0:7480:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:0.0:1782239797.745869:0:7480:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:0.0:1782239797.745999:0:7480:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:3.0:1782239797.747524:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:3.0:1782239797.747646:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:3.0:1782239797.747715:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 10000000:01000000:3.0:1782239797.747740:0:5783:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1782239797.748641:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bb5c2a45c00/0x8c5345f1c1ec4b60 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239797.748666:0:5783:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bb5c1676e00/0x8c5345f1c1ec4ab1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4aaa expref: 16 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239797.748693:0:5783:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bb5c0031a00/0x8c5345f1c1ec4adb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4ad4 expref: 16 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239797.748700:0:5783:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bb5c1676000/0x8c5345f1c1ec4b05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4afe expref: 16 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239797.748707:0:5783:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bb5c1676400/0x8c5345f1c1ec4b21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4b1a expref: 16 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239797.748713:0:5783:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bb602044600/0x8c5345f1c1ec4b44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4b3d expref: 16 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239797.748721:0:5783:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bb5c2a45c00/0x8c5345f1c1ec4b60 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239797.749215:0:5783:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bb602044600/0x8c5345f1c1ec4b44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8c5345f1c1ec4b3d expref: 16 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239797.749243:0:5783:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bb602044600/0x8c5345f1c1ec4b44 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8c5345f1c1ec4b3d expref: 16 pid: 5784 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239797.749259:0:5783:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb601359f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5783:1868813758902912:0@lo:104: 00000100:00100000:3.0:1782239797.749334:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782239797.749430:0:5783:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bb5c1676400/0x8c5345f1c1ec4b21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8c5345f1c1ec4b1a expref: 16 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239797.749438:0:5783:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bb5c1676400/0x8c5345f1c1ec4b21 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8c5345f1c1ec4b1a expref: 16 pid: 5783 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239797.749448:0:5783:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb601358a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5783:1868813758903040:0@lo:104: 00010000:00010000:3.0:1782239797.749488:0:5783:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bb5c1676000/0x8c5345f1c1ec4b05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8c5345f1c1ec4afe expref: 16 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239797.749508:0:5783:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bb5c1676000/0x8c5345f1c1ec4b05 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8c5345f1c1ec4afe expref: 16 pid: 5784 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239797.749518:0:5783:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb601359180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5783:1868813758903168:0@lo:104: 00010000:00010000:3.0:1782239797.749553:0:5783:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bb5c0031a00/0x8c5345f1c1ec4adb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8c5345f1c1ec4ad4 expref: 16 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239797.749561:0:5783:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bb5c0031a00/0x8c5345f1c1ec4adb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8c5345f1c1ec4ad4 expref: 16 pid: 5783 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239797.749570:0:5783:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb601359c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5783:1868813758903296:0@lo:104: 00010000:00010000:3.0:1782239797.749592:0:5783:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bb5c1676e00/0x8c5345f1c1ec4ab1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8c5345f1c1ec4aaa expref: 16 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239797.749599:0:5783:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bb5c1676e00/0x8c5345f1c1ec4ab1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8c5345f1c1ec4aaa expref: 16 pid: 5783 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239797.749607:0:5783:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb601358e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5783:1868813758903424:0@lo:104: 00000100:00100000:3.0:1782239797.749623:0:5783:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5d1cab9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782239797.757355:0:5774:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1782239797.757404:0:5774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239797.757445:0:5774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239797.757455:0:5774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239797.757465:0:5774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239797.757480:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758902912 00000100:00100000:0.0:1782239797.757488:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758902912 00000100:00100000:2.0:1782239797.757547:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758903040 00000100:00100000:0.0:1782239797.757548:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758903168 00000100:00100000:2.0:1782239797.757554:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758903040 00000100:00100000:0.0:1782239797.757554:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758903168 00000100:00100000:0.0:1782239797.757580:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758903296 00000100:00100000:0.0:1782239797.757584:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758903296 00000100:00100000:2.0:1782239797.757586:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758903424 00000100:00100000:2.0:1782239797.757603:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758903424 00000100:00100000:0.0:1782239797.757604:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1782239797.757617:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5c8402c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+7:5783:x1868813758902912:12345-0@lo:104: 00010000:00010000:0.0:1782239797.757634:0:5774:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.132@tcp lock: ffff9bb602045000/0x8c5345f1c1ec4b3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c5345f1c1ec4b44 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239797.757706:0:5774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782239797.757713:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5c8402c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+7:5783:x1868813758902912:12345-0@lo:104: Request processed in 100us (8380us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239797.757720:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1782239797.757788:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1782239797.757794:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00010000:00010000:2.0:1782239797.757796:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.132@tcp lock: ffff9bb602045000/0x8c5345f1c1ec4b3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c5345f1c1ec4b44 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782239797.757805:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5dee25c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+6:5783:x1868813758903168:12345-0@lo:104: 00010000:00010000:2.0:1782239797.757809:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb602045000 already unused, calling callback (ffffffffc1d0cc20) 10000000:00010000:2.0:1782239797.757815:0:5778:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.132@tcp lock: ffff9bb602045000/0x8c5345f1c1ec4b3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x8c5345f1c1ec4b44 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239797.757817:0:5774:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a45600/0x8c5345f1c1ec4afe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c5345f1c1ec4b05 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239797.757834:0:5778:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.132@tcp lock: ffff9bb602045000/0x8c5345f1c1ec4b3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x8c5345f1c1ec4b44 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782239797.757854:0:5778:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.132@tcp lock: ffff9bb602045000/0x8c5345f1c1ec4b3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x8c5345f1c1ec4b44 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782239797.757861:0:5778:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1782239797.757889:0:5774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782239797.757895:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5dee25c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+6:5783:x1868813758903168:12345-0@lo:104: Request processed in 95us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239797.757903:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:2.0:1782239797.757906:0:5778:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.132@tcp lock: ffff9bb602045000/0x8c5345f1c1ec4b3d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c5345f1c1ec4b44 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239797.757915:0:5778:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1782239797.757919:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1782239797.757928:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5dee24380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+5:5783:x1868813758903040:12345-0@lo:104: 00010000:00010000:0.0:1782239797.757936:0:5774:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a45a00/0x8c5345f1c1ec4b1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c5345f1c1ec4b21 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239797.757939:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.132@tcp lock: ffff9bb602045000/0x8c5345f1c1ec4b3d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c5345f1c1ec4b44 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239797.757955:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.132@tcp lock: ffff9bb602045000/0x8c5345f1c1ec4b3d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c5345f1c1ec4b44 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239797.757971:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782239797.757975:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a45600/0x8c5345f1c1ec4afe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c5345f1c1ec4b05 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239797.757977:0:5774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:2.0:1782239797.757988:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5c2a45600 already unused, calling callback (ffffffffc1d0cc20) 00000100:00100000:0.0:1782239797.757989:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5dee24380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+5:5783:x1868813758903040:12345-0@lo:104: Request processed in 60us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239797.757995:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 10000000:00010000:2.0:1782239797.758002:0:5778:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a45600/0x8c5345f1c1ec4afe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x8c5345f1c1ec4b05 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239797.758011:0:5778:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a45600/0x8c5345f1c1ec4afe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x8c5345f1c1ec4b05 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782239797.758017:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 10000000:00010000:2.0:1782239797.758023:0:5778:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a45600/0x8c5345f1c1ec4afe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x8c5345f1c1ec4b05 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782239797.758030:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5dee26680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+4:5783:x1868813758903296:12345-0@lo:104: 10000000:01000000:2.0:1782239797.758034:0:5778:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1782239797.758050:0:5778:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a45600/0x8c5345f1c1ec4afe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c5345f1c1ec4b05 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239797.758056:0:5778:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782239797.758070:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a45600/0x8c5345f1c1ec4afe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c5345f1c1ec4b05 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239797.758076:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a45600/0x8c5345f1c1ec4afe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c5345f1c1ec4b05 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239797.758085:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782239797.758088:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a45a00/0x8c5345f1c1ec4b1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c5345f1c1ec4b21 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239797.758094:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5c2a45a00 already unused, calling callback (ffffffffc1d0cc20) 10000000:00010000:2.0:1782239797.758097:0:5778:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a45a00/0x8c5345f1c1ec4b1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8c5345f1c1ec4b21 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239797.758103:0:5778:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a45a00/0x8c5345f1c1ec4b1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8c5345f1c1ec4b21 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782239797.758119:0:5778:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a45a00/0x8c5345f1c1ec4b1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8c5345f1c1ec4b21 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782239797.758125:0:5778:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1782239797.758143:0:5778:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a45a00/0x8c5345f1c1ec4b1a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c5345f1c1ec4b21 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239797.758148:0:5778:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782239797.758154:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a45a00/0x8c5345f1c1ec4b1a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c5345f1c1ec4b21 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239797.758173:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a45a00/0x8c5345f1c1ec4b1a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c5345f1c1ec4b21 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239797.758182:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782239797.758184:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782239797.758185:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782239797.758194:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782239797.758208:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f48c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3306:1868813758903552:0@lo:103: 00000100:00100000:2.0:1782239797.758257:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782239797.758602:0:5774:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.132@tcp lock: ffff9bb5c1677000/0x8c5345f1c1ec4ad4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c5345f1c1ec4adb expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239797.758645:0:5774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782239797.758652:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5dee26680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+4:5783:x1868813758903296:12345-0@lo:104: Request processed in 625us (1195us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239797.758659:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1782239797.758675:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1782239797.758683:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5dee24000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+3:5783:x1868813758903424:12345-0@lo:104: 00010000:00010000:0.0:1782239797.758690:0:5774:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.132@tcp lock: ffff9bb602045400/0x8c5345f1c1ec4aaa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c5345f1c1ec4ab1 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239797.758728:0:5774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1782239797.758733:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5dee24000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+3:5783:x1868813758903424:12345-0@lo:104: Request processed in 52us (1267us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239797.758740:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1782239797.758775:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782239797.758779:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.132@tcp lock: ffff9bb5c1677000/0x8c5345f1c1ec4ad4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c5345f1c1ec4adb expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239797.758787:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5c1677000 already unused, calling callback (ffffffffc1d0cc20) 10000000:00010000:0.0:1782239797.758790:0:5779:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.132@tcp lock: ffff9bb5c1677000/0x8c5345f1c1ec4ad4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8c5345f1c1ec4adb expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239797.758797:0:5779:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.132@tcp lock: ffff9bb5c1677000/0x8c5345f1c1ec4ad4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8c5345f1c1ec4adb expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782239797.758803:0:5779:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.132@tcp lock: ffff9bb5c1677000/0x8c5345f1c1ec4ad4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8c5345f1c1ec4adb expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782239797.758809:0:5779:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1782239797.758830:0:5779:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.132@tcp lock: ffff9bb5c1677000/0x8c5345f1c1ec4ad4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c5345f1c1ec4adb expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239797.758836:0:5779:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782239797.758843:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.132@tcp lock: ffff9bb5c1677000/0x8c5345f1c1ec4ad4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c5345f1c1ec4adb expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239797.758850:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.132@tcp lock: ffff9bb5c1677000/0x8c5345f1c1ec4ad4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c5345f1c1ec4adb expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239797.758872:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782239797.758875:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.132@tcp lock: ffff9bb602045400/0x8c5345f1c1ec4aaa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c5345f1c1ec4ab1 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239797.758882:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb602045400 already unused, calling callback (ffffffffc1d0cc20) 10000000:00010000:0.0:1782239797.758884:0:5779:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.132@tcp lock: ffff9bb602045400/0x8c5345f1c1ec4aaa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8c5345f1c1ec4ab1 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239797.758891:0:5779:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.132@tcp lock: ffff9bb602045400/0x8c5345f1c1ec4aaa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8c5345f1c1ec4ab1 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782239797.758897:0:5779:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.132@tcp lock: ffff9bb602045400/0x8c5345f1c1ec4aaa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8c5345f1c1ec4ab1 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782239797.758903:0:5779:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1782239797.758917:0:5779:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.132@tcp lock: ffff9bb602045400/0x8c5345f1c1ec4aaa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c5345f1c1ec4ab1 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239797.758923:0:5779:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782239797.758929:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.132@tcp lock: ffff9bb602045400/0x8c5345f1c1ec4aaa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c5345f1c1ec4ab1 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239797.758936:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.132@tcp lock: ffff9bb602045400/0x8c5345f1c1ec4aaa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c5345f1c1ec4ab1 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239797.758953:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782239797.758957:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782239797.758959:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782239797.758972:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5dee26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3307:1868813758904064:0@lo:103: 00000100:00100000:2.0:1782239797.758986:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5dee24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3306:1868813758903936:0@lo:103: 00000100:00100000:0.0:1782239797.759014:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239797.759096:0:5783:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb601359f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5783:1868813758902912:0@lo:104: 00000100:00100000:3.0:1782239797.759106:0:5783:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb601358a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5783:1868813758903040:0@lo:104: 00000100:00100000:3.0:1782239797.759113:0:5783:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb601359180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5783:1868813758903168:0@lo:104: 00000100:00100000:3.0:1782239797.759120:0:5783:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb601359c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5783:1868813758903296:0@lo:104: 00000100:00100000:3.0:1782239797.759127:0:5783:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb601358e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5783:1868813758903424:0@lo:104: 00010000:00010000:3.0:1782239797.759163:0:5783:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bb5c2a45c00/0x8c5345f1c1ec4b60 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239797.759437:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758903552 00000100:00100000:3.0:1782239797.759444:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758903552 00000100:00100000:0.0:1782239797.759459:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f48c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3304:1868813758903680:0@lo:103: 00010000:00010000:3.0:1782239797.759465:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bb602044600/0x8c5345f1c1ec4b44 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c5345f1c1ec4b3d expref: 17 pid: 5784 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782239797.759483:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239797.759487:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758904064 00000100:00100000:3.0:1782239797.759489:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758904064 00010000:00010000:3.0:1782239797.759500:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bb5c1676e00/0x8c5345f1c1ec4ab1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c5345f1c1ec4aaa expref: 18 pid: 5783 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782239797.759506:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782239797.759511:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758903680 00000100:00100000:0.0:1782239797.759512:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f48c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3304:1868813758903808:0@lo:103: 00000100:00100000:3.0:1782239797.759513:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758903680 00010000:00010000:3.0:1782239797.759523:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bb5c1676000/0x8c5345f1c1ec4b05 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c5345f1c1ec4afe expref: 19 pid: 5784 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239797.759535:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1782239797.759541:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:3306:x1868813758903552:12345-0@lo:103: 00010000:00010000:3.0:1782239797.759552:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782239797.759557:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bb602044600/0x8c5345f1c1ec4b44 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c5345f1c1ec4b3d expref: 19 pid: 5784 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239797.759567:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bb602044600/0x8c5345f1c1ec4b44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8c5345f1c1ec4b3d expref: 19 pid: 5784 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239797.759582:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb602044600/0x8c5345f1c1ec4b44 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8c5345f1c1ec4b3d expref: 19 pid: 5784 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782239797.759601:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782239797.759632:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782239797.759667:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782239797.759701:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+18:3306:x1868813758903552:12345-0@lo:103: Request processed in 160us (1444us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239797.759708:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1782239797.759721:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758903808 00000100:00100000:3.0:1782239797.759727:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758903808 00000100:00100000:2.0:1782239797.759727:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782239797.759743:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bb5c1676400/0x8c5345f1c1ec4b21 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c5345f1c1ec4b1a expref: 18 pid: 5783 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239797.759779:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f48c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3306:1868813758903552:0@lo:103: 00000100:00100000:3.0:1782239797.759788:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758903936 00000100:00100000:3.0:1782239797.759793:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758903936 00010000:00010000:3.0:1782239797.759807:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bb5c0031a00/0x8c5345f1c1ec4adb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c5345f1c1ec4ad4 expref: 19 pid: 5783 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239797.759821:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1782239797.759826:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5dee24e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:3307:x1868813758904064:12345-0@lo:103: 00010000:00010000:3.0:1782239797.759835:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782239797.759839:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bb5c1676e00/0x8c5345f1c1ec4ab1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c5345f1c1ec4aaa expref: 19 pid: 5783 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239797.759847:0:5776:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:3.0:1782239797.759848:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bb5c1676e00/0x8c5345f1c1ec4ab1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8c5345f1c1ec4aaa expref: 19 pid: 5783 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239797.759863:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb5c1676e00/0x8c5345f1c1ec4ab1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8c5345f1c1ec4aaa expref: 19 pid: 5783 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239797.759875:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782239797.759911:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5dee24e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+18:3307:x1868813758904064:12345-0@lo:103: Request processed in 84us (898us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239797.759917:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1782239797.759928:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1782239797.759933:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5dee25180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+17:3304:x1868813758903680:12345-0@lo:103: 00010000:00010000:3.0:1782239797.759946:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782239797.759951:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bb5c1676000/0x8c5345f1c1ec4b05 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c5345f1c1ec4afe expref: 17 pid: 5784 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239797.759960:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bb5c1676000/0x8c5345f1c1ec4b05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8c5345f1c1ec4afe expref: 17 pid: 5784 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239797.759972:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb5c1676000/0x8c5345f1c1ec4b05 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8c5345f1c1ec4afe expref: 17 pid: 5784 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239797.759979:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5dee26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3307:1868813758904064:0@lo:103: 00010000:00010000:3.0:1782239797.759983:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782239797.760023:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5dee25180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+16:3304:x1868813758903680:12345-0@lo:103: Request processed in 90us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239797.760030:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1782239797.760046:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f48c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3304:1868813758903680:0@lo:103: 00000100:00100000:3.0:1782239797.760049:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1782239797.760062:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5dee26d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+15:3304:x1868813758903808:12345-0@lo:103: 00010000:00010000:3.0:1782239797.760070:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782239797.760076:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bb5c1676400/0x8c5345f1c1ec4b21 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c5345f1c1ec4b1a expref: 15 pid: 5783 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239797.760084:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bb5c1676400/0x8c5345f1c1ec4b21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8c5345f1c1ec4b1a expref: 15 pid: 5783 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239797.760094:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb5c1676400/0x8c5345f1c1ec4b21 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8c5345f1c1ec4b1a expref: 15 pid: 5783 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239797.760103:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782239797.760133:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5dee26d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+14:3304:x1868813758903808:12345-0@lo:103: Request processed in 74us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239797.760139:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1782239797.760157:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1782239797.760163:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+13:3306:x1868813758903936:12345-0@lo:103: 00000100:00100000:0.0:1782239797.760163:0:5776:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1782239797.760338:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f48c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3304:1868813758903808:0@lo:103: 00010000:00010000:3.0:1782239797.760368:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782239797.760374:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bb5c0031a00/0x8c5345f1c1ec4adb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c5345f1c1ec4ad4 expref: 13 pid: 5783 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239797.760383:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bb5c0031a00/0x8c5345f1c1ec4adb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8c5345f1c1ec4ad4 expref: 13 pid: 5783 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239797.760393:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb5c0031a00/0x8c5345f1c1ec4adb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8c5345f1c1ec4ad4 expref: 13 pid: 5783 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239797.760406:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bb5c2a45c00/0x8c5345f1c1ec4b60 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239797.760414:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb5c2a45c00/0x8c5345f1c1ec4b60 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239797.760428:0:5777:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bb5c2a45c00/0x8c5345f1c1ec4b60 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239797.760436:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bb5c2a45c00/0x8c5345f1c1ec4b60 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239797.760443:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bb5c2a45c00/0x8c5345f1c1ec4b60 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239797.760450:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bb5c2a45c00/0x8c5345f1c1ec4b60 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239797.760456:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5c2a45c00 already unused, calling callback (ffffffffc1728ce0) 00010000:00010000:3.0:1782239797.760460:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bb5c2a45c00/0x8c5345f1c1ec4b60 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239797.760474:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bb5c2a45c00/0x8c5345f1c1ec4b60 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239797.760496:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bb5c2a45c00/0x8c5345f1c1ec4b60 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239797.760506:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782239797.760527:0:5783:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bb5c2a45c00/0x8c5345f1c1ec4b60 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239797.760537:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bb5c2a45c00/0x8c5345f1c1ec4b60 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239797.760555:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb5c2a45c00/0x8c5345f1c1ec4b60 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1782239797.760574:0:5783:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1782239797.760646:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+12:3306:x1868813758903936:12345-0@lo:103: Request processed in 423us (863us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239797.760654:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1782239797.761129:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5dee24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3306:1868813758903936:0@lo:103: 00000100:00100000:3.0:1782239797.839818:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5c8869850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+11:7475:x1868813758902784:12345-0@lo:253: Request processed in 120424us (120640us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239797.839832:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1782239797.839942:0:7475:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb6018cc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:7475:1868813758902784:0@lo:253: 10000000:01000000:0.0:1782239797.839957:0:7475:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1782239797.839960:0:7475:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1782239797.839962:0:7475:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1782239797.839963:0:7475:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782239797.839964:0:7475:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1782239797.839966:0:7475:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782239797.839967:0:7475:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782239797.839968:0:7475:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1782239797.839970:0:7475:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1782239797.839971:0:7475:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782239797.839972:0:7475:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1782239797.839994:0:7475:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9bb5eddbf000 from lustre-OST0001 10000000:01000000:0.0:1782239797.840024:0:7475:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1782239797.840026:0:7475:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1782239797.840034:0:7475:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9bb5d1bd99c0 local copy 10000000:01000000:0.0:1782239797.840038:0:7475:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1782239797.840075:0:7475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5c0031800/0x8c5345f1c1ec4b67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239797.840086:0:7475:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.132@tcp lock: ffff9bb5c0031800/0x8c5345f1c1ec4b67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239797.840113:0:7475:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff9bb5c0031800/0x8c5345f1c1ec4b67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782239797.840133:0:7475:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5dee24a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:7475:1868813758904192:0@lo:101: 00000100:00100000:0.0:1782239797.840169:0:7475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239797.840277:0:7475:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5d1f15f00 going to sleep for 11 seconds 00000100:00100000:2.0:1782239797.844621:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758904192 00000100:00100000:2.0:1782239797.844637:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758904192 00000100:00100000:0.0:1782239797.844825:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1782239797.844835:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5c886a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+11:7475:x1868813758904192:12345-0@lo:101: 00010000:00010000:0.0:1782239797.844858:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782239797.844879:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb5c0030400/0x8c5345f1c1ec4b6e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c5345f1c1ec4b67 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239797.844908:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb5c0030400/0x8c5345f1c1ec4b6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4b67 expref: 12 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239797.844920:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb5c0030400/0x8c5345f1c1ec4b6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4b67 expref: 12 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239797.844930:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5c0030400, rc 0) 00000100:00100000:0.0:1782239797.845008:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5c886a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+12:7475:x1868813758904192:12345-0@lo:101: Request processed in 174us (4838us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239797.845016:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1782239797.846526:0:7475:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5dee24a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:7475:1868813758904192:0@lo:101: 00010000:00010000:1.0:1782239797.846551:0:7475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff9bb5c0031800/0x8c5345f1c1ec4b67 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x8c5345f1c1ec4b6e expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239797.846562:0:7475:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff9bb5c0031800/0x8c5345f1c1ec4b67 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x8c5345f1c1ec4b6e expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239797.846694:0:7475:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb6018cce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:7475:1868813758904320:0@lo:501: 00000100:00100000:1.0:1782239797.846788:0:7475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239797.846829:0:7475:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5e8e80000 going to sleep for 11 seconds 00000100:00100000:3.0:1782239797.846969:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758904320 00000100:00100000:3.0:1782239797.846975:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758904320 00000100:00100000:3.0:1782239797.847010:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1782239797.847018:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5c8868850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+12:7475:x1868813758904320:12345-0@lo:501: 00000100:00100000:3.0:1782239797.847266:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5c8868850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+12:7475:x1868813758904320:12345-0@lo:501: Request processed in 247us (517us total) trans 0 rc -2/-2 00000100:00100000:3.0:1782239797.847273:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1782239797.847409:0:7475:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb6018cce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:7475:1868813758904320:0@lo:501: 10000000:01000000:1.0:1782239797.847424:0:7475:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.132@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1782239797.847453:0:7475:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.132@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1782239797.847460:0:7475:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5c0031800/0x8c5345f1c1ec4b67 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x8c5345f1c1ec4b6e expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239797.847469:0:7475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5c0031800/0x8c5345f1c1ec4b67 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x8c5345f1c1ec4b6e expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239797.847488:0:7475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.132@tcp lock: ffff9bb5c0031800/0x8c5345f1c1ec4b67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x8c5345f1c1ec4b6e expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239797.847525:0:7475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1782239797.847546:0:7475:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9bb5eddbf000 10000000:01000000:1.0:1782239797.847550:0:7475:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1782239797.847555:0:7475:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1782239797.847558:0:7475:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1782239797.847562:0:7475:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1782239797.847564:0:7475:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1782239797.847587:0:7475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5c1677400/0x8c5345f1c1ec4b75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239797.847595:0:7475:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: ffff9bb5c1677400/0x8c5345f1c1ec4b75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239797.847603:0:7475:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff9bb5c1677400/0x8c5345f1c1ec4b75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239797.847618:0:7475:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb6018cce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:7475:1868813758904448:0@lo:101: 00000100:00100000:1.0:1782239797.847648:0:7475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239797.847672:0:7475:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5e8e80d80 going to sleep for 11 seconds 00010000:00010000:2.0:1782239797.847788:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782239797.847795:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.132@tcp lock: ffff9bb5c0031800/0x8c5345f1c1ec4b67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x8c5345f1c1ec4b6e expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239797.847802:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5c0031800 already unused, calling callback (ffffffffc1d0cc20) 10000000:00010000:2.0:1782239797.847805:0:5779:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.132@tcp lock: ffff9bb5c0031800/0x8c5345f1c1ec4b67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x8c5345f1c1ec4b6e expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239797.847813:0:5779:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.132@tcp lock: ffff9bb5c0031800/0x8c5345f1c1ec4b67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x8c5345f1c1ec4b6e expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782239797.847820:0:5779:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.132@tcp lock: ffff9bb5c0031800/0x8c5345f1c1ec4b67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x8c5345f1c1ec4b6e expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782239797.847826:0:5779:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1782239797.847846:0:5779:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.132@tcp lock: ffff9bb5c0031800/0x8c5345f1c1ec4b67 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x8c5345f1c1ec4b6e expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239797.847853:0:5779:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782239797.847879:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.132@tcp lock: ffff9bb5c0031800/0x8c5345f1c1ec4b67 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x8c5345f1c1ec4b6e expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239797.847887:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.132@tcp lock: ffff9bb5c0031800/0x8c5345f1c1ec4b67 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x8c5345f1c1ec4b6e expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239797.847912:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782239797.847914:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782239797.847916:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782239797.847924:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782239797.847936:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f48c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3305:1868813758904576:0@lo:103: 00000100:00100000:2.0:1782239797.847965:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239797.848000:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758904576 00000100:00100000:2.0:1782239797.848004:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758904576 00000100:00100000:2.0:1782239797.848036:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782239797.848043:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+12:3305:x1868813758904576:12345-0@lo:103: 00010000:00010000:2.0:1782239797.848052:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782239797.848064:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb5c0030400/0x8c5345f1c1ec4b6e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8c5345f1c1ec4b67 expref: 12 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239797.848081:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782239797.848109:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+11:3305:x1868813758904576:12345-0@lo:103: Request processed in 66us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239797.848115:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782239797.848139:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f48c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3305:1868813758904576:0@lo:103: 00000100:00100000:0.0:1782239797.848261:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758904448 00000100:00100000:0.0:1782239797.848266:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758904448 00000100:00100000:0.0:1782239797.848301:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1782239797.848309:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5c886ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+11:7475:x1868813758904448:12345-0@lo:101: 00010000:00010000:0.0:1782239797.848319:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782239797.848338:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb5c0031a00/0x8c5345f1c1ec4b7c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c5345f1c1ec4b75 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239797.848363:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb5c0031a00/0x8c5345f1c1ec4b7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4b75 expref: 12 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239797.848374:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb5c0031a00/0x8c5345f1c1ec4b7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4b75 expref: 12 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239797.848381:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5c0031a00, rc 0) 00000100:00100000:0.0:1782239797.848411:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5c886ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+12:7475:x1868813758904448:12345-0@lo:101: Request processed in 104us (762us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239797.848417:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1782239797.848611:0:7475:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb6018cce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:7475:1868813758904448:0@lo:101: 00010000:00010000:1.0:1782239797.848623:0:7475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff9bb5c1677400/0x8c5345f1c1ec4b75 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4b7c expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239797.848632:0:7475:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff9bb5c1677400/0x8c5345f1c1ec4b75 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c5345f1c1ec4b7c expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239797.848721:0:7475:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb6018cce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:7475:1868813758904704:0@lo:501: 00000100:00100000:1.0:1782239797.848787:0:7475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239797.848806:0:7475:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5e8e80d80 going to sleep for 11 seconds 00000100:00100000:0.0:1782239797.848859:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758904704 00000100:00100000:0.0:1782239797.848864:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758904704 00000100:00100000:0.0:1782239797.848892:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1782239797.848899:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5c8869050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+12:7475:x1868813758904704:12345-0@lo:501: 00000100:00100000:0.0:1782239797.849094:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5c8869050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+12:7475:x1868813758904704:12345-0@lo:501: Request processed in 195us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239797.849101:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1782239797.849399:0:7475:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb6018cce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:7475:1868813758904704:0@lo:501: 00000100:00100000:1.0:1782239797.849429:0:7475:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb6018cce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:7475:1868813758904832:0@lo:503: 00000100:00100000:1.0:1782239797.849468:0:7475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239797.849491:0:7475:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5e8e80d80 going to sleep for 11 seconds 00000100:00100000:2.0:1782239797.849606:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758904832 00000100:00100000:2.0:1782239797.849611:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758904832 00000100:00100000:2.0:1782239797.849645:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1782239797.849651:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5c8869450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+12:7475:x1868813758904832:12345-0@lo:503: 00000100:00100000:2.0:1782239797.849826:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5c8869450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+12:7475:x1868813758904832:12345-0@lo:503: Request processed in 174us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239797.849833:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1782239797.850082:0:7475:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb6018cce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:7475:1868813758904832:0@lo:503: 00000040:00080000:1.0:1782239797.850454:0:7475:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1782239797.850612:0:7475:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb6018cce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:7475:1868813758904960:0@lo:502: 00000100:00100000:1.0:1782239797.850655:0:7475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239797.850691:0:7475:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5e8e80d80 going to sleep for 11 seconds 00000100:00100000:2.0:1782239797.851320:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758904960 00000100:00100000:2.0:1782239797.851327:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758904960 00000100:00100000:2.0:1782239797.851360:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1782239797.851367:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8d76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+12:7475:x1868813758904960:12345-0@lo:502: 00000100:00100000:2.0:1782239797.852337:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8d76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+12:7475:x1868813758904960:12345-0@lo:502: Request processed in 967us (1679us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239797.852347:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1782239797.859357:0:7475:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb6018cce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:7475:1868813758904960:0@lo:502: 00000040:00080000:1.0:1782239797.859699:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1782239797.859810:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1782239797.859848:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1782239797.859910:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1782239797.859953:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1782239797.859989:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1782239797.860028:0:7475:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb6018cce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:7475:1868813758905088:0@lo:502: 00000100:00100000:1.0:1782239797.860102:0:7475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239797.860154:0:7475:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5e8e80d80 going to sleep for 11 seconds 00000100:00100000:3.0:1782239797.861815:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758905088 00000100:00100000:3.0:1782239797.861828:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758905088 00000100:00100000:3.0:1782239797.861881:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1782239797.861891:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8d75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+12:7475:x1868813758905088:12345-0@lo:502: 00000100:00100000:3.0:1782239797.862156:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8d75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+12:7475:x1868813758905088:12345-0@lo:502: Request processed in 265us (2053us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239797.862174:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1782239797.862321:0:7475:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb6018cce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:7475:1868813758905088:0@lo:502: 00000040:00080000:1.0:1782239797.862476:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1782239797.862498:0:7475:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:3.0:1782239797.863140:0:7484:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1782239797.863149:0:7484:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1782239797.863156:0:7484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782239797.863158:0:7484:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1782239797.863176:0:7484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1782239797.863193:0:7484:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9bb5f78a19c0) 00000020:00000080:3.0:1782239797.863217:0:7484:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:3.0:1782239797.863234:0:7484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1782239797.863297:0:7484:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bb5eddbf000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1782239797.863306:0:7484:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1782239797.863312:0:7484:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x8c5345f1c1ec4b8a 00010000:00010000:0.0:1782239797.866836:0:7484:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:0.0:1782239797.867186:0:7484:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:0.0:1782239797.875295:0:7484:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1782239797.875600:0:7484:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:0.0:1782239797.885710:0:7484:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1782239797.886646:0:7484:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1782239797.892706:0:7484:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1782239797.892723:0:7484:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782239797.892730:0:7484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782239797.892739:0:7484:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1782239797.892743:0:7484:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782239797.892787:0:7484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782239797.892789:0:7484:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1782239797.892794:0:7484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1782239797.892796:0:7484:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1782239797.892858:0:7484:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782239797.892862:0:7484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782239797.892864:0:7484:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:0.0:1782239797.892868:0:7484:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1782239797.893108:0:7475:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:2.0:1782239797.893135:0:7475:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1782239797.893156:0:7475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5c1677400/0x8c5345f1c1ec4b75 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4b7c expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239797.893178:0:7475:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff9bb5c1677400/0x8c5345f1c1ec4b75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4b7c expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782239797.893186:0:7475:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9bb5eddbf000 from 1 10000000:01000000:2.0:1782239797.893189:0:7475:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1782239797.893236:0:7475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb602045000/0x8c5345f1c1ec4b91 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239797.893244:0:7475:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: ffff9bb602045000/0x8c5345f1c1ec4b91 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239797.893254:0:7475:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff9bb602045000/0x8c5345f1c1ec4b91 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239797.893279:0:7475:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f48c2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:7475:1868813758905216:0@lo:101: 00000100:00100000:2.0:1782239797.893355:0:7475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239797.893405:0:7475:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c84b9cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1782239797.893426:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758905216 00000100:00100000:2.0:1782239797.893439:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758905216 00000100:00100000:2.0:1782239797.893481:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1782239797.893490:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8d76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+12:7475:x1868813758905216:12345-0@lo:101: 00010000:00010000:2.0:1782239797.893517:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782239797.893531:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb602044e00/0x8c5345f1c1ec4b98 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c5345f1c1ec4b91 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239797.893557:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb602044e00/0x8c5345f1c1ec4b98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4b91 expref: 13 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239797.893568:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb602044e00/0x8c5345f1c1ec4b98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4b91 expref: 13 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239797.893577:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb602044e00, rc 0) 00000100:00100000:2.0:1782239797.893617:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8d76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+13:7475:x1868813758905216:12345-0@lo:101: Request processed in 128us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239797.893624:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1782239797.893675:0:7475:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f48c2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:7475:1868813758905216:0@lo:101: 00010000:00010000:2.0:1782239797.893689:0:7475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff9bb602045000/0x8c5345f1c1ec4b91 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4b98 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239797.893697:0:7475:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff9bb602045000/0x8c5345f1c1ec4b91 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c5345f1c1ec4b98 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239797.893814:0:7475:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f48c2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:7475:1868813758905344:0@lo:501: 00000100:00100000:2.0:1782239797.893840:0:7475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239797.893863:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758905344 00000100:00100000:2.0:1782239797.893867:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758905344 00000100:00100000:2.0:1782239797.893889:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1782239797.893905:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8d74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+13:7475:x1868813758905344:12345-0@lo:501: 00000100:00100000:2.0:1782239797.894119:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8d74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+13:7475:x1868813758905344:12345-0@lo:501: Request processed in 214us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239797.894127:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1782239797.894153:0:7475:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c84b9cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1782239797.894166:0:7475:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f48c2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:7475:1868813758905344:0@lo:501: 00000100:00100000:2.0:1782239797.894193:0:7475:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f48c2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:7475:1868813758905472:0@lo:503: 00000100:00100000:2.0:1782239797.894246:0:7475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239797.894267:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758905472 00000100:00100000:2.0:1782239797.894272:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758905472 00000100:00100000:2.0:1782239797.894293:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1782239797.894300:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8d76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+13:7475:x1868813758905472:12345-0@lo:503: 00000100:00100000:2.0:1782239797.894584:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8d76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+13:7475:x1868813758905472:12345-0@lo:503: Request processed in 283us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239797.894591:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1782239797.894625:0:7475:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5d1cab9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782239797.894639:0:7475:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f48c2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:7475:1868813758905472:0@lo:503: 00000040:00080000:2.0:1782239797.894937:0:7475:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1782239797.894997:0:7475:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f48c2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:7475:1868813758905600:0@lo:502: 00000100:00100000:2.0:1782239797.895034:0:7475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239797.895063:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758905600 00000100:00100000:2.0:1782239797.895067:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758905600 00000100:00100000:2.0:1782239797.895091:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1782239797.895098:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8d75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+13:7475:x1868813758905600:12345-0@lo:502: 00000100:00100000:2.0:1782239797.895263:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8d75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+13:7475:x1868813758905600:12345-0@lo:502: Request processed in 165us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239797.895280:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1782239797.895314:0:7475:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5d1cab9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782239797.895329:0:7475:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f48c2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:7475:1868813758905600:0@lo:502: 00000040:00080000:2.0:1782239797.895585:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1782239797.895629:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1782239797.895650:0:7475:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f48c2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:7475:1868813758905728:0@lo:502: 00000100:00100000:2.0:1782239797.895683:0:7475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239797.895706:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758905728 00000100:00100000:2.0:1782239797.895709:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758905728 00000100:00100000:2.0:1782239797.895730:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1782239797.895736:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8d75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+13:7475:x1868813758905728:12345-0@lo:502: 00000100:00100000:2.0:1782239797.895870:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8d75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+13:7475:x1868813758905728:12345-0@lo:502: Request processed in 134us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239797.895877:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1782239797.895907:0:7475:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5d1cab9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782239797.895920:0:7475:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f48c2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:7475:1868813758905728:0@lo:502: 00000040:00080000:2.0:1782239797.895990:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1782239797.895998:0:7475:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1782239797.924478:0:7487:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782239797.924495:0:7487:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782239797.924497:0:7487:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1782239797.924505:0:7487:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bb5eddbf000 00000020:00000080:1.0:1782239797.924508:0:7487:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1782239797.924530:0:7487:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782239797.924533:0:7487:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782239797.924535:0:7487:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1782239797.924537:0:7487:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1782239797.926668:0:7475:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1782239797.926710:0:7475:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1782239797.926740:0:7475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb602045000/0x8c5345f1c1ec4b91 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4b98 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239797.926772:0:7475:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff9bb602045000/0x8c5345f1c1ec4b91 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4b98 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782239797.926836:0:7475:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1782239797.926839:0:7475:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9bb5eddbf000 10000000:01000000:0.0:1782239797.926843:0:7475:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9bb5eddbf000 10000000:01000000:0.0:1782239797.926847:0:7475:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1782239797.926854:0:7475:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9bb5eddbf000 from 1 10000000:01000000:0.0:1782239797.926857:0:7475:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1782239797.926895:0:7475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5c0030e00/0x8c5345f1c1ec4b9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239797.926905:0:7475:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: ffff9bb5c0030e00/0x8c5345f1c1ec4b9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239797.926916:0:7475:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff9bb5c0030e00/0x8c5345f1c1ec4b9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782239797.926959:0:7475:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5dee24a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:7475:1868813758905856:0@lo:101: 00000100:00100000:0.0:1782239797.927026:0:7475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239797.927074:0:7475:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5cfcecd80 going to sleep for 11 seconds 00000100:00100000:3.0:1782239797.927089:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758905856 00000100:00100000:3.0:1782239797.927098:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758905856 00000100:00100000:3.0:1782239797.927150:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1782239797.927160:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8d77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+13:7475:x1868813758905856:12345-0@lo:101: 00010000:00010000:3.0:1782239797.927174:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782239797.927188:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb5c2a44c00/0x8c5345f1c1ec4ba6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c5345f1c1ec4b9f expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239797.927212:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb5c2a44c00/0x8c5345f1c1ec4ba6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4b9f expref: 14 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239797.927222:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb5c2a44c00/0x8c5345f1c1ec4ba6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4b9f expref: 14 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239797.927242:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5c2a44c00, rc 0) 00000100:00100000:3.0:1782239797.927292:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8d77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+14:7475:x1868813758905856:12345-0@lo:101: Request processed in 133us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239797.927300:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1782239797.927346:0:7475:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5dee24a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:7475:1868813758905856:0@lo:101: 00010000:00010000:1.0:1782239797.927362:0:7475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff9bb5c0030e00/0x8c5345f1c1ec4b9f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4ba6 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239797.927372:0:7475:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff9bb5c0030e00/0x8c5345f1c1ec4b9f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c5345f1c1ec4ba6 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239797.927474:0:7475:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb6018cce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:7475:1868813758905984:0@lo:501: 00000100:00100000:1.0:1782239797.927513:0:7475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239797.927539:0:7475:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5e8e80000 going to sleep for 11 seconds 00000100:00100000:3.0:1782239797.927606:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758905984 00000100:00100000:3.0:1782239797.927612:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758905984 00000100:00100000:3.0:1782239797.927652:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1782239797.927659:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8d75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+14:7475:x1868813758905984:12345-0@lo:501: 00000100:00100000:3.0:1782239797.927930:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8d75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+14:7475:x1868813758905984:12345-0@lo:501: Request processed in 270us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239797.927938:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1782239797.927958:0:7475:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb6018cce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:7475:1868813758905984:0@lo:501: 00000100:00100000:0.0:1782239797.927991:0:7475:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5dee26300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:7475:1868813758906112:0@lo:503: 00000100:00100000:0.0:1782239797.928028:0:7475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239797.928057:0:7475:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5cfcec180 going to sleep for 11 seconds 00000100:00100000:3.0:1782239797.928085:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758906112 00000100:00100000:3.0:1782239797.928090:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758906112 00000100:00100000:3.0:1782239797.928118:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1782239797.928124:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8d74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+14:7475:x1868813758906112:12345-0@lo:503: 00000100:00100000:3.0:1782239797.928303:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8d74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+14:7475:x1868813758906112:12345-0@lo:503: Request processed in 178us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239797.928311:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1782239797.928328:0:7475:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5dee26300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:7475:1868813758906112:0@lo:503: 00000040:00080000:0.0:1782239797.928672:0:7475:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1782239797.928725:0:7475:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5dee26300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:7475:1868813758906240:0@lo:502: 00000100:00100000:0.0:1782239797.928791:0:7475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239797.928811:0:7475:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5cfcec180 going to sleep for 11 seconds 00000100:00100000:3.0:1782239797.929376:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758906240 00000100:00100000:3.0:1782239797.929383:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758906240 00000100:00100000:3.0:1782239797.929422:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1782239797.929429:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8d74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+14:7475:x1868813758906240:12345-0@lo:502: 00000100:00100000:3.0:1782239797.929655:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8d74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+14:7475:x1868813758906240:12345-0@lo:502: Request processed in 225us (862us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239797.929665:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1782239797.929852:0:7475:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5dee26300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:7475:1868813758906240:0@lo:502: 00000040:00080000:0.0:1782239797.930128:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1782239797.930326:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1782239797.930373:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1782239797.930417:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1782239797.930450:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1782239797.930832:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1782239797.930884:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1782239797.930918:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1782239797.930966:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1782239797.930997:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1782239797.931028:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1782239797.931072:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1782239797.931104:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1782239797.931145:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1782239797.932898:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1782239797.932988:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1782239797.933031:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1782239797.933112:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1782239797.933153:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1782239797.933194:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1782239797.933262:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1782239797.933307:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1782239797.933347:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1782239797.933395:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1782239797.933429:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1782239797.933477:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1782239797.933543:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1782239797.933585:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:1.0:1782239797.933620:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1782239797.933670:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:1.0:1782239797.933706:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:1.0:1782239797.933738:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:1.0:1782239797.933816:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:1.0:1782239797.933873:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:1.0:1782239797.933911:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:1.0:1782239797.933961:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:1.0:1782239797.933999:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:1.0:1782239797.934047:0:7475:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb6018cfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:7475:1868813758906368:0@lo:502: 00000100:00100000:1.0:1782239797.934124:0:7475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239797.934169:0:7475:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5e8e80d80 going to sleep for 11 seconds 00000100:00100000:3.0:1782239797.934195:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758906368 00000100:00100000:3.0:1782239797.934203:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758906368 00000100:00100000:3.0:1782239797.934267:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1782239797.934276:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8d74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+14:7475:x1868813758906368:12345-0@lo:502: 00000100:00100000:3.0:1782239797.934506:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8d74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+14:7475:x1868813758906368:12345-0@lo:502: Request processed in 230us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239797.934514:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1782239797.939467:0:7475:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb6018cfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:7475:1868813758906368:0@lo:502: 00000040:00080000:1.0:1782239797.939623:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:1.0:1782239797.939639:0:7475:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:1.0:1782239797.941739:0:7489:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1782239797.941794:0:7489:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9bb60182b380) 00000020:00000080:1.0:1782239797.941821:0:7489:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:1.0:1782239797.941990:0:7489:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bb5eddbf000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1782239797.941994:0:7489:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bb5eddbf000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1782239797.941997:0:7489:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9bb5eddbf000 3 00010000:00080000:1.0:1782239797.942029:0:7489:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bb5f7f23000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.132@tcp at head 00010000:00010000:1.0:1782239797.943787:0:7489:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:1.0:1782239797.943891:0:7489:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1782239797.943929:0:7489:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1782239797.943941:0:7489:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x8c5345f1c1ec4bb4 00000100:00080000:1.0:1782239797.943951:0:7489:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1782239797.943964:0:7489:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9bb5f7f23000 using connection 192.168.203.132@tcp/0@lo 00000100:00100000:1.0:1782239797.943999:0:7489:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bb6018cfb80 x1868813758906496/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1782239797.944018:0:7489:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1782239797.944667:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb6018cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1868813758906496:0@lo:38: 00000100:00100000:3.0:1782239797.944788:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239797.944846:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758906496 00000100:00100000:3.0:1782239797.944854:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758906496 00000100:00100000:3.0:1782239797.944888:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1782239797.944895:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb601358e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3303:x1868813758906496:12345-0@lo:38: 00010000:00080000:3.0:1782239797.944919:0:5790:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 177 last 0 00000020:00000080:3.0:1782239797.944961:0:5790:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x8c5345f1c1ec4bbb 00000004:00100000:3.0:1782239797.944975:0:5790:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1782239797.945023:0:5790:0:(import.c:65:import_set_state_nolock()) ffff9bb5f7cd9800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782239797.945074:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb601358e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1868813758906496:12345-0@lo:38: Request processed in 177us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239797.945081:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1782239797.945118:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bb6018cfb80 x1868813758906496/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782239807 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782239797.945128:0:3303:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1782239797.945135:0:3303:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1782239797.945141:0:3303:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1782239797.945146:0:3303:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1782239797.945149:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9bb5f7f23000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1782239797.945154:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb6018cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1868813758906496:0@lo:38: 00000100:00100000:2.0:1782239797.945914:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f48c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1868813758906624:0@lo:400: 00000100:00100000:2.0:1782239797.945959:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239797.945999:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f48c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1868813758906752:0@lo:400: 00000100:00100000:2.0:1782239797.946027:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239797.946045:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782239797.946051:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f48c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813758906880:0@lo:400: 00000100:00100000:2.0:1782239797.946079:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239797.946126:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758906624 00000100:00100000:2.0:1782239797.946131:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758906624 00000100:00100000:2.0:1782239797.946182:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758906752 00000100:00100000:2.0:1782239797.946186:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758906752 00000100:00100000:2.0:1782239797.946220:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1782239797.946241:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1868813758906624:12345-0@lo:400: 00000100:00100000:2.0:1782239797.946290:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1868813758906624:12345-0@lo:400: Request processed in 50us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239797.946297:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1782239797.946319:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1782239797.946327:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1868813758906752:12345-0@lo:400: 00000100:00100000:2.0:1782239797.946362:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1868813758906752:12345-0@lo:400: Request processed in 36us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239797.946370:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1782239797.946394:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758906880 00000100:00100000:2.0:1782239797.946398:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758906880 00000100:00100000:2.0:1782239797.946427:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782239797.946435:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1868813758906880:12345-0@lo:400: 00000100:00100000:2.0:1782239797.946473:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1868813758906880:12345-0@lo:400: Request processed in 39us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239797.946480:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1782239797.946511:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782239797.946516:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1782239797.946542:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bb5f48c2a00 x1868813758906624/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782239813 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782239797.946555:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f48c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1868813758906624:0@lo:400: 00010000:00080000:2.0:1782239797.946583:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bb5f48c0a80 x1868813758906880/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782239813 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782239797.946606:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f48c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813758906880:0@lo:400: 00010000:00080000:2.0:1782239797.946620:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bb5f48c2300 x1868813758906752/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782239813 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782239797.946629:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f48c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1868813758906752:0@lo:400: 00000040:00080000:1.0:1782239797.950079:0:7489:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:0.0:1782239797.950239:0:7475:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:0.0:1782239797.950264:0:7475:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1782239797.950282:0:7475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5c0030e00/0x8c5345f1c1ec4b9f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4ba6 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239797.950293:0:7475:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff9bb5c0030e00/0x8c5345f1c1ec4b9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4ba6 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1782239797.950345:0:7475:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1782239797.950347:0:7475:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1782239797.950349:0:7475:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782239797.950350:0:7475:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782239797.950351:0:7475:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782239797.950352:0:7475:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782239797.950354:0:7475:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1782239797.950355:0:7475:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1782239797.950357:0:7475:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1782239797.950358:0:7475:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782239797.950360:0:7475:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1782239797.950364:0:7475:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:0.0:1782239797.950366:0:7475:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1782239797.950368:0:7475:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1782239797.950369:0:7475:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782239797.950370:0:7475:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782239797.950371:0:7475:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782239797.950372:0:7475:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782239797.950374:0:7475:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1782239797.950375:0:7475:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1782239797.950376:0:7475:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1782239797.950377:0:7475:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782239797.950378:0:7475:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1782239797.950406:0:7475:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1782239797.950424:0:7475:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5dee26300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:7475:1868813758907008:0@lo:253: 00000100:00100000:0.0:1782239797.950489:0:7475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239797.950600:0:7475:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5d1342b40 going to sleep for 11 seconds 00000100:00100000:2.0:1782239797.950693:0:7490:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f48c2300 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7490:1868813758907136:0@lo:901: 00000100:00100000:2.0:1782239797.950728:0:7490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239797.950796:0:7490:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5d1caba80 going to sleep for 11 seconds 00000100:00100000:0.0:1782239797.950969:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758907136 00000100:00100000:0.0:1782239797.950976:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758907136 00000100:00100000:0.0:1782239797.951029:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782239797.951037:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7490:x1868813758907136:12345-0@lo:901: 00000100:00100000:0.0:1782239797.951441:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7490:x1868813758907136:12345-0@lo:901: Request processed in 403us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239797.951448:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782239797.951518:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758907008 00000100:00100000:3.0:1782239797.951524:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758907008 00000100:00080000:2.0:1782239797.951630:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1782239797.951658:0:7490:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bb5f48c2300 x1868813758907136/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1782239813 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782239797.951663:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1782239797.951679:0:7490:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f48c2300 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7490:1868813758907136:0@lo:901: 00000100:00100000:3.0:1782239797.951682:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8d77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+14:7475:x1868813758907008:12345-0@lo:253: 20000000:01000000:3.0:1782239797.951929:0:5783:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1782239797.951944:0:5783:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1782239798.003624:0:5783:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1782239798.003643:0:5783:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1782239798.003675:0:5806:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1782239798.003681:0:5806:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1782239798.003702:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bb5c0031e00/0x8c5345f1c1ec4bc2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239798.003722:0:5806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bb602045e00/0x8c5345f1c1ec4b13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4b0c expref: 14 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239798.003733:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bb5c0031e00/0x8c5345f1c1ec4bc2 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239798.003792:0:5806:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bb602045e00/0x8c5345f1c1ec4b13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8c5345f1c1ec4b0c expref: 14 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239798.003806:0:5806:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bb602045e00/0x8c5345f1c1ec4b13 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8c5345f1c1ec4b0c expref: 14 pid: 5784 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782239798.003820:0:5806:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5dee24700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5806:1868813758907264:0@lo:104: 00000100:00100000:0.0:1782239798.003881:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239798.003936:0:5806:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb601a1c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782239798.003964:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758907264 00000100:00100000:1.0:1782239798.003972:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758907264 00000100:00100000:1.0:1782239798.004023:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1782239798.004032:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5dee25500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+3:5806:x1868813758907264:12345-0@lo:104: 00010000:00010000:1.0:1782239798.004045:0:5773:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a45200/0x8c5345f1c1ec4b0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c5345f1c1ec4b13 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239798.004105:0:5773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782239798.004112:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5dee25500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+3:5806:x1868813758907264:12345-0@lo:104: Request processed in 81us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239798.004119:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1782239798.004156:0:5806:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5dee24700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5806:1868813758907264:0@lo:104: 00010000:00010000:2.0:1782239798.004186:0:5806:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bb5c0031e00/0x8c5345f1c1ec4bc2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239798.004291:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782239798.004297:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a45200/0x8c5345f1c1ec4b0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c5345f1c1ec4b13 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239798.004315:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5c2a45200 already unused, calling callback (ffffffffc1d0cc20) 10000000:00010000:0.0:1782239798.004319:0:5778:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a45200/0x8c5345f1c1ec4b0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8c5345f1c1ec4b13 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239798.004326:0:5778:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a45200/0x8c5345f1c1ec4b0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8c5345f1c1ec4b13 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782239798.004333:0:5778:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a45200/0x8c5345f1c1ec4b0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8c5345f1c1ec4b13 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782239798.004337:0:5778:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1782239798.004404:0:5778:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a45200/0x8c5345f1c1ec4b0c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c5345f1c1ec4b13 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239798.004411:0:5778:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782239798.004432:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a45200/0x8c5345f1c1ec4b0c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c5345f1c1ec4b13 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239798.004439:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a45200/0x8c5345f1c1ec4b0c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c5345f1c1ec4b13 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239798.004461:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782239798.004464:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782239798.004467:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782239798.004478:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5dee26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3304:1868813758907392:0@lo:103: 00000100:00100000:0.0:1782239798.004523:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239798.004964:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758907392 00000100:00100000:3.0:1782239798.004970:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758907392 00010000:00010000:3.0:1782239798.004994:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bb602045e00/0x8c5345f1c1ec4b13 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c5345f1c1ec4b0c expref: 15 pid: 5784 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239798.005022:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1782239798.005030:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d810d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+15:3304:x1868813758907392:12345-0@lo:103: 00010000:00010000:3.0:1782239798.005042:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782239798.005047:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bb602045e00/0x8c5345f1c1ec4b13 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c5345f1c1ec4b0c expref: 15 pid: 5784 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239798.005057:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bb602045e00/0x8c5345f1c1ec4b13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8c5345f1c1ec4b0c expref: 15 pid: 5784 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239798.005070:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb602045e00/0x8c5345f1c1ec4b13 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8c5345f1c1ec4b0c expref: 15 pid: 5784 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239798.005084:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bb5c0031e00/0x8c5345f1c1ec4bc2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239798.005092:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb5c0031e00/0x8c5345f1c1ec4bc2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1782239798.005105:0:5777:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.011015872s 00010000:00010000:3.0:1782239798.005109:0:5777:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bb5c0031e00/0x8c5345f1c1ec4bc2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239798.005115:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bb5c0031e00/0x8c5345f1c1ec4bc2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239798.005135:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bb5c0031e00/0x8c5345f1c1ec4bc2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239798.005142:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bb5c0031e00/0x8c5345f1c1ec4bc2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239798.005147:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5c0031e00 already unused, calling callback (ffffffffc1728ce0) 00010000:00010000:3.0:1782239798.005151:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bb5c0031e00/0x8c5345f1c1ec4bc2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239798.005158:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bb5c0031e00/0x8c5345f1c1ec4bc2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239798.005180:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bb5c0031e00/0x8c5345f1c1ec4bc2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239798.005191:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782239798.005389:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d810d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+14:3304:x1868813758907392:12345-0@lo:103: Request processed in 358us (863us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239798.005397:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1782239798.005462:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5dee26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3304:1868813758907392:0@lo:103: 00010000:00010000:1.0:1782239798.005594:0:5806:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bb5c0031e00/0x8c5345f1c1ec4bc2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239798.005603:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bb5c0031e00/0x8c5345f1c1ec4bc2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239798.005610:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb5c0031e00/0x8c5345f1c1ec4bc2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782239798.027098:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8d77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+13:7475:x1868813758907008:12345-0@lo:253: Request processed in 75411us (76597us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239798.027114:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1782239798.027255:0:7475:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5dee26300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:7475:1868813758907008:0@lo:253: 10000000:01000000:2.0:1782239798.027272:0:7475:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1782239798.027275:0:7475:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1782239798.027276:0:7475:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1782239798.027278:0:7475:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782239798.027279:0:7475:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782239798.027280:0:7475:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782239798.027281:0:7475:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782239798.027282:0:7475:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782239798.027284:0:7475:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1782239798.027285:0:7475:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1782239798.027286:0:7475:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782239798.027293:0:7475:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1782239798.027311:0:7475:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1782239798.032030:0:7475:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1782239798.033429:0:7475:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1782239798.033738:0:7475:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1782239798.033956:0:7475:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1782239798.034471:0:7475:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1782239798.034883:0:7475:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1782239798.036568:0:7475:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1782239798.353408:0:7475:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1782239798.353415:0:7475:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1782239798.353452:0:7475:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1782239798.353520:0:7475:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.132@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1782239798.353538:0:7475:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1782239798.353586:0:7475:0:(super25.c:187:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1782239798.496024:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782239799.528139:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782239799.583897:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5dee27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813758907520:0@lo:13: 00000100:00100000:0.0:1782239799.583991:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239799.588034:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758907520 00000100:00100000:2.0:1782239799.588055:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758907520 00000100:00100000:2.0:1782239799.588145:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782239799.588157:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5dee25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1868813758907520:12345-0@lo:13: 00002000:00000024:2.0:1782239799.588219:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782239799.588380:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5dee25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1868813758907520:12345-0@lo:13: Request processed in 224us (4395us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239799.588389:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1782239799.588414:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1782239799.588618:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb5dee27480 x1868813758907520/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782239815 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782239799.588644:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5dee27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813758907520:0@lo:13: 00010000:00010000:3.0:1782239800.545285:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782239801.567949:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782239802.591310:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782239803.170522:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb6018ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1868813758907776:0@lo:400: 00000100:00100000:1.0:1782239803.170592:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239803.170644:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1782239803.170658:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb6018cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3307:1868813758907648:0@lo:400: 00000100:00100000:1.0:1782239803.170688:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239803.170708:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb6018cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1868813758908160:0@lo:400: 00000100:00100000:1.0:1782239803.170732:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239803.170779:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb6018cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1868813758907904:0@lo:400: 00000100:00100000:1.0:1782239803.170804:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239803.170820:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782239803.170824:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb6018cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1868813758908032:0@lo:400: 00000100:00100000:1.0:1782239803.170849:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239803.170878:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758907776 00000100:00100000:1.0:1782239803.170884:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758907776 00000100:00100000:1.0:1782239803.170921:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758908160 00000100:00100000:1.0:1782239803.170924:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758908160 00000100:00100000:3.0:1782239803.171113:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758907648 00000100:00100000:3.0:1782239803.171118:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758907648 00000100:00100000:3.0:1782239803.171151:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1782239803.171160:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8d77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+13:3307:x1868813758907648:12345-0@lo:400: 00000100:00100000:3.0:1782239803.171219:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8d77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+13:3307:x1868813758907648:12345-0@lo:400: Request processed in 60us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239803.171228:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1782239803.171274:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb6018cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3307:1868813758907648:0@lo:400: 00000100:00100000:1.0:1782239803.171405:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758907904 00000100:00100000:1.0:1782239803.171410:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758907904 00000100:00100000:1.0:1782239803.171427:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1782239803.171434:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb6018cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1868813758907776:12345-0@lo:400: 00000100:00100000:1.0:1782239803.171527:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb6018cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1868813758907776:12345-0@lo:400: Request processed in 93us (933us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239803.171534:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1782239803.171547:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1782239803.171553:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb6018cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1868813758908160:12345-0@lo:400: 00000100:00100000:1.0:1782239803.171581:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb6018cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1868813758908160:12345-0@lo:400: Request processed in 28us (847us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239803.171588:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1782239803.171598:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1782239803.171604:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb6018cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1868813758907904:12345-0@lo:400: 00000100:00100000:1.0:1782239803.171647:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb6018cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1868813758907904:12345-0@lo:400: Request processed in 43us (842us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239803.171654:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1782239803.171679:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758908032 00000100:00100000:1.0:1782239803.171683:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758908032 00000100:00100000:1.0:1782239803.171709:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782239803.171715:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb6018cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1868813758908032:12345-0@lo:400: 00000100:00100000:1.0:1782239803.171763:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb6018cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1868813758908032:12345-0@lo:400: Request processed in 32us (896us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239803.171770:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1782239803.171790:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782239803.171795:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1782239803.171818:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb6018cf800 x1868813758908032/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782239819 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782239803.171830:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb6018cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1868813758908032:0@lo:400: 00010000:00080000:1.0:1782239803.171841:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb6018cdc00 x1868813758907904/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782239819 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782239803.171849:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb6018cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1868813758907904:0@lo:400: 00010000:00080000:3.0:1782239803.176366:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb6018ce680 x1868813758907776/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782239819 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782239803.176386:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb6018ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1868813758907776:0@lo:400: 00010000:00080000:3.0:1782239803.176432:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb6018cc000 x1868813758908160/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782239819 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782239803.176442:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb6018cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1868813758908160:0@lo:400: 00010000:00010000:1.0:1782239803.621434:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782239804.640250:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782239804.703581:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5dee27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1868813758908288:0@lo:13: 00000100:00100000:2.0:1782239804.703659:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239804.703982:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758908288 00000100:00100000:0.0:1782239804.703991:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758908288 00000100:00100000:0.0:1782239804.704039:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1782239804.704050:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1868813758908288:12345-0@lo:13: 00002000:00000024:0.0:1782239804.704103:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782239804.704164:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1868813758908288:12345-0@lo:13: Request processed in 115us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239804.704173:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1782239804.704209:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb5dee27480 x1868813758908288/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782239820 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782239804.704233:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5dee27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1868813758908288:0@lo:13: 00000001:02000400:2.0:1782239805.080940:0:7832:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg332-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1782239805.664550:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1782239805.729210:0:5787:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1782239805.729219:0:5787:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9bb5c8863000 from 30 10000000:01000000:1.0:1782239805.729225:0:5787:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1782239805.729285:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5c1677200/0x8c5345f1c1ec4bc9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239805.729297:0:5787:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: ffff9bb5c1677200/0x8c5345f1c1ec4bc9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239805.729308:0:5787:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff9bb5c1677200/0x8c5345f1c1ec4bc9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239805.729331:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb6018cdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758908416:0@lo:101: 00000100:00100000:1.0:1782239805.729397:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239805.729531:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758908416 00000100:00100000:0.0:1782239805.729549:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758908416 00000100:00100000:0.0:1782239805.729601:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1782239805.729610:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8d76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+13:5787:x1868813758908416:12345-0@lo:101: 00010000:00010000:0.0:1782239805.729623:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782239805.729634:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb5c0030400/0x8c5345f1c1ec4bd0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c5345f1c1ec4bc9 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239805.729657:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb5c0030400/0x8c5345f1c1ec4bd0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4bc9 expref: 14 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239805.729668:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb5c0030400/0x8c5345f1c1ec4bd0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4bc9 expref: 14 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239805.729691:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5c0030400, rc 0) 00000100:00100000:0.0:1782239805.729727:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8d76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+14:5787:x1868813758908416:12345-0@lo:101: Request processed in 118us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239805.729734:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1782239805.729901:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5e8e800c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782239805.729922:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb6018cdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758908416:0@lo:101: 00010000:00010000:1.0:1782239805.729937:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff9bb5c1677200/0x8c5345f1c1ec4bc9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4bd0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239805.729945:0:5787:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff9bb5c1677200/0x8c5345f1c1ec4bc9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c5345f1c1ec4bd0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239805.729997:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb6018cdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758908544:0@lo:501: 00000100:00100000:1.0:1782239805.730025:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239805.730053:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5e8e800c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782239805.731715:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758908544 00000100:00100000:0.0:1782239805.731727:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758908544 00000100:00100000:0.0:1782239805.731789:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1782239805.731799:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8d77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+14:5787:x1868813758908544:12345-0@lo:501: 00000100:00100000:0.0:1782239805.732207:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8d77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+14:5787:x1868813758908544:12345-0@lo:501: Request processed in 408us (2180us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239805.732215:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1782239805.732535:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb6018cdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758908544:0@lo:501: 00000100:00100000:1.0:1782239805.732813:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb6018cdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758908672:0@lo:503: 00000100:00100000:1.0:1782239805.732868:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239805.732901:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5e8e800c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782239805.733823:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758908672 00000100:00100000:0.0:1782239805.733833:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758908672 00000100:00100000:0.0:1782239805.733887:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1782239805.733896:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d1bad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+14:5787:x1868813758908672:12345-0@lo:503: 00000100:00100000:0.0:1782239805.734264:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d1bad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+14:5787:x1868813758908672:12345-0@lo:503: Request processed in 368us (1395us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239805.734271:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1782239805.734796:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb6018cdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758908672:0@lo:503: 00000100:00100000:1.0:1782239805.757912:0:7859:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb6018cdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:7859:1868813758908800:0@lo:502: 00000100:00100000:1.0:1782239805.758014:0:7859:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239805.758050:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758908800 00000100:00100000:0.0:1782239805.758058:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758908800 00000100:00100000:1.0:1782239805.758063:0:7859:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5e8e809c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782239805.758109:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1782239805.758457:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d1bae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+14:7859:x1868813758908800:12345-0@lo:502: 00000100:00100000:0.0:1782239805.760046:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d1bae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+14:7859:x1868813758908800:12345-0@lo:502: Request processed in 1589us (2027us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239805.760060:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1782239805.760185:0:7859:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb6018cdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:7859:1868813758908800:0@lo:502: 00000100:00100000:0.0:1782239805.760261:0:7859:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5dee25f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:7859:1868813758908928:0@lo:502: 00000100:00100000:0.0:1782239805.760316:0:7859:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239805.760351:0:7859:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5e8d62a80 going to sleep for 11 seconds 00000100:00100000:0.0:1782239805.760374:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758908928 00000100:00100000:0.0:1782239805.760379:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758908928 00000100:00100000:0.0:1782239805.760412:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1782239805.760418:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d1bac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+14:7859:x1868813758908928:12345-0@lo:502: 00000100:00100000:0.0:1782239805.760654:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d1bac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+14:7859:x1868813758908928:12345-0@lo:502: Request processed in 234us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239805.760662:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1782239805.760714:0:7859:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5dee25f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:7859:1868813758908928:0@lo:502: 00000040:00080000:0.0:1782239805.763037:0:7859:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1782239805.765071:0:5787:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1782239805.765114:0:5787:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1782239805.765126:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5c1677200/0x8c5345f1c1ec4bc9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4bd0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239805.765138:0:5787:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff9bb5c1677200/0x8c5345f1c1ec4bc9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4bd0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782239805.765147:0:5787:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1782239805.765150:0:5787:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:1.0:1782239805.765152:0:5787:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1782239805.765201:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5c1676a00/0x8c5345f1c1ec4bd7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239805.765210:0:5787:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: ffff9bb5c1676a00/0x8c5345f1c1ec4bd7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239805.765222:0:5787:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff9bb5c1676a00/0x8c5345f1c1ec4bd7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239805.765245:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb6018cf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758909056:0@lo:101: 00000100:00100000:1.0:1782239805.765318:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239805.765632:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5e8e80780 going to sleep for 11 seconds 00000100:00100000:2.0:1782239805.765680:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758909056 00000100:00100000:2.0:1782239805.765689:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758909056 00000100:00100000:1.0:1782239805.765818:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1782239805.765829:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d1baec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+14:5787:x1868813758909056:12345-0@lo:101: 00010000:00010000:1.0:1782239805.765843:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782239805.765855:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb5c1677000/0x8c5345f1c1ec4bde lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c5345f1c1ec4bd7 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239805.765893:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb5c1677000/0x8c5345f1c1ec4bde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4bd7 expref: 15 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239805.765904:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb5c1677000/0x8c5345f1c1ec4bde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4bd7 expref: 15 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239805.765913:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5c1677000, rc 0) 00000100:00100000:1.0:1782239805.765962:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d1baec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+15:5787:x1868813758909056:12345-0@lo:101: Request processed in 133us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239805.765969:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1782239805.766016:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb6018cf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758909056:0@lo:101: 00010000:00010000:1.0:1782239805.766030:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff9bb5c1676a00/0x8c5345f1c1ec4bd7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4bde expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239805.766039:0:5787:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff9bb5c1676a00/0x8c5345f1c1ec4bd7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c5345f1c1ec4bde expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239805.766090:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb6018cf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758909184:0@lo:501: 00000100:00100000:1.0:1782239805.766118:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239805.766142:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5e8e80780 going to sleep for 11 seconds 00000100:00100000:1.0:1782239805.766811:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758909184 00000100:00100000:1.0:1782239805.766817:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758909184 00000100:00100000:1.0:1782239805.766849:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1782239805.766856:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d1bad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+15:5787:x1868813758909184:12345-0@lo:501: 00000100:00100000:1.0:1782239805.767142:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d1bad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+15:5787:x1868813758909184:12345-0@lo:501: Request processed in 285us (1022us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239805.767150:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1782239805.767211:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb6018cf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758909184:0@lo:501: 00000100:00100000:1.0:1782239805.767247:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb6018cf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758909312:0@lo:503: 00000100:00100000:1.0:1782239805.767292:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239805.767309:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5e8e80780 going to sleep for 11 seconds 00000100:00100000:1.0:1782239805.767322:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758909312 00000100:00100000:1.0:1782239805.767326:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758909312 00000100:00100000:1.0:1782239805.767357:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1782239805.767363:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d1bad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+15:5787:x1868813758909312:12345-0@lo:503: 00000100:00100000:1.0:1782239805.767677:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d1bad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+15:5787:x1868813758909312:12345-0@lo:503: Request processed in 313us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239805.767684:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1782239805.767721:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb6018cf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758909312:0@lo:503: 00000100:00100000:0.0:1782239805.770514:0:7860:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5dee25f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:7860:1868813758909440:0@lo:502: 00000100:00100000:0.0:1782239805.770596:0:7860:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239805.770635:0:7860:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5f7cbd9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782239805.770664:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758909440 00000100:00100000:0.0:1782239805.770671:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758909440 00000100:00100000:0.0:1782239805.770715:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1782239805.770725:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d1baf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+15:7860:x1868813758909440:12345-0@lo:502: 00000100:00100000:0.0:1782239805.771543:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d1baf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+15:7860:x1868813758909440:12345-0@lo:502: Request processed in 814us (942us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239805.771554:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1782239805.771620:0:7860:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5dee25f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:7860:1868813758909440:0@lo:502: 00000020:01000000:0.0:1782239805.771654:0:7860:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782239805.771669:0:7860:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782239805.771672:0:7860:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:0.0:1782239805.771681:0:7860:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1782239805.771683:0:7860:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1782239805.771710:0:7860:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5dee25f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:7860:1868813758909568:0@lo:502: 00000100:00100000:0.0:1782239805.771777:0:7860:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239805.771807:0:7860:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5f7cbd9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782239805.771840:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758909568 00000100:00100000:0.0:1782239805.771845:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758909568 00000100:00100000:0.0:1782239805.771884:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1782239805.771893:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d1badc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+15:7860:x1868813758909568:12345-0@lo:502: 00000100:00100000:0.0:1782239805.775760:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d1badc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+15:7860:x1868813758909568:12345-0@lo:502: Request processed in 3844us (3958us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239805.775776:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1782239805.775820:0:7860:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5dee25f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:7860:1868813758909568:0@lo:502: 00000020:01000000:2.0:1782239805.775863:0:7860:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782239805.775872:0:7860:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782239805.775874:0:7860:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:2.0:1782239805.775879:0:7860:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:0.0:1782239805.776018:0:5787:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1782239805.776043:0:5787:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1782239805.776053:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5c1676a00/0x8c5345f1c1ec4bd7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4bde expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239805.776065:0:5787:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff9bb5c1676a00/0x8c5345f1c1ec4bd7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4bde expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782239805.776076:0:5787:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1782239805.776078:0:5787:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9bb5c8415000 from 30 10000000:01000000:0.0:1782239805.776081:0:5787:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1782239805.776112:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5c0031e00/0x8c5345f1c1ec4be5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239805.776133:0:5787:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: ffff9bb5c0031e00/0x8c5345f1c1ec4be5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239805.776154:0:5787:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff9bb5c0031e00/0x8c5345f1c1ec4be5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782239805.776183:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5dee25f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758909696:0@lo:101: 00000100:00100000:0.0:1782239805.776219:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239805.776251:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5f7cbde40 going to sleep for 11 seconds 00000100:00100000:2.0:1782239805.776377:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758909696 00000100:00100000:2.0:1782239805.776391:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758909696 00000100:00100000:2.0:1782239805.776645:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1782239805.776657:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d1bac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+15:5787:x1868813758909696:12345-0@lo:101: 00010000:00010000:2.0:1782239805.776679:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782239805.776695:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb602044200/0x8c5345f1c1ec4bec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c5345f1c1ec4be5 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239805.776722:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb602044200/0x8c5345f1c1ec4bec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4be5 expref: 16 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239805.776733:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb602044200/0x8c5345f1c1ec4bec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4be5 expref: 16 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239805.776743:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb602044200, rc 0) 00000100:00100000:2.0:1782239805.776813:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d1bac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+16:5787:x1868813758909696:12345-0@lo:101: Request processed in 159us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239805.776819:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1782239805.776948:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5dee25f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758909696:0@lo:101: 00010000:00010000:1.0:1782239805.776963:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff9bb5c0031e00/0x8c5345f1c1ec4be5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4bec expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239805.776984:0:5787:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff9bb5c0031e00/0x8c5345f1c1ec4be5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c5345f1c1ec4bec expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239805.777036:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb6018cf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758909824:0@lo:501: 00000100:00100000:1.0:1782239805.777067:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239805.777087:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5e8e80780 going to sleep for 11 seconds 00000100:00100000:0.0:1782239805.777682:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758909824 00000100:00100000:0.0:1782239805.777688:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758909824 00000100:00100000:0.0:1782239805.777909:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1782239805.777919:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d1bacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+16:5787:x1868813758909824:12345-0@lo:501: 00000100:00100000:0.0:1782239805.779056:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d1bacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+16:5787:x1868813758909824:12345-0@lo:501: Request processed in 1134us (1984us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239805.779066:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1782239805.779185:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb6018cf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758909824:0@lo:501: 00000100:00100000:1.0:1782239805.779239:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb6018cf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758909952:0@lo:503: 00000100:00100000:1.0:1782239805.779290:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239805.783496:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758909952 00000100:00100000:2.0:1782239805.783510:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758909952 00000100:00100000:2.0:1782239805.783563:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1782239805.783575:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d1bac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+16:5787:x1868813758909952:12345-0@lo:503: 00000100:00100000:2.0:1782239805.784191:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d1bac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+16:5787:x1868813758909952:12345-0@lo:503: Request processed in 616us (4898us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239805.784199:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1782239805.793923:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5e8e80780 going to sleep for 11 seconds 00000100:00100000:1.0:1782239805.793962:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb6018cf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758909952:0@lo:503: 00000100:00100000:1.0:1782239805.794428:0:7864:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb6018cf800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:7864:1868813758910080:0@lo:502: 00000100:00100000:1.0:1782239805.794493:0:7864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239805.794516:0:7864:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5e8e80cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1782239805.794559:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758910080 00000100:00100000:2.0:1782239805.794566:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758910080 00000100:00100000:2.0:1782239805.794611:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1782239805.794621:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d1bafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+16:7864:x1868813758910080:12345-0@lo:502: 00000100:00100000:2.0:1782239805.795367:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d1bafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+16:7864:x1868813758910080:12345-0@lo:502: Request processed in 745us (872us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239805.795377:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1782239805.795626:0:7864:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb6018cf800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:7864:1868813758910080:0@lo:502: 00000100:00100000:1.0:1782239805.795680:0:7864:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb6018cf800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:7864:1868813758910208:0@lo:502: 00000100:00100000:1.0:1782239805.795721:0:7864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239805.795896:0:7864:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5e8e80cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1782239805.795950:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758910208 00000100:00100000:0.0:1782239805.795956:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758910208 00000100:00100000:0.0:1782239805.796817:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1782239805.796830:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d1baf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+16:7864:x1868813758910208:12345-0@lo:502: 00000100:00100000:0.0:1782239805.797089:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d1baf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+16:7864:x1868813758910208:12345-0@lo:502: Request processed in 262us (1367us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239805.797097:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1782239805.797987:0:7864:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb6018cf800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:7864:1868813758910208:0@lo:502: 00000040:00080000:1.0:1782239805.798029:0:7864:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1782239805.798124:0:5787:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1782239805.798142:0:5787:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1782239805.798153:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5c0031e00/0x8c5345f1c1ec4be5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4bec expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239805.798163:0:5787:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff9bb5c0031e00/0x8c5345f1c1ec4be5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4bec expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782239805.798182:0:5787:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1782239805.798184:0:5787:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9bb5c8415000 from 5 10000000:01000000:1.0:1782239805.798187:0:5787:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1782239805.798221:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5c1676e00/0x8c5345f1c1ec4bf3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239805.798230:0:5787:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: ffff9bb5c1676e00/0x8c5345f1c1ec4bf3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239805.798251:0:5787:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff9bb5c1676e00/0x8c5345f1c1ec4bf3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239805.798270:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb6018cf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758910336:0@lo:101: 00000100:00100000:1.0:1782239805.798317:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239805.802192:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5e8e80cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1782239805.802347:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758910336 00000100:00100000:2.0:1782239805.802358:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758910336 00000100:00100000:0.0:1782239805.802435:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1782239805.802449:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d1bae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+16:5787:x1868813758910336:12345-0@lo:101: 00010000:00010000:0.0:1782239805.802466:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782239805.802485:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb5c0030000/0x8c5345f1c1ec4bfa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c5345f1c1ec4bf3 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239805.802523:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb5c0030000/0x8c5345f1c1ec4bfa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4bf3 expref: 17 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239805.802533:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb5c0030000/0x8c5345f1c1ec4bfa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4bf3 expref: 17 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239805.802542:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5c0030000, rc 0) 00000100:00100000:0.0:1782239805.802607:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d1bae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+17:5787:x1868813758910336:12345-0@lo:101: Request processed in 162us (4290us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239805.802615:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1782239805.802694:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb6018cf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758910336:0@lo:101: 00010000:00010000:1.0:1782239805.802712:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff9bb5c1676e00/0x8c5345f1c1ec4bf3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4bfa expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239805.802722:0:5787:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff9bb5c1676e00/0x8c5345f1c1ec4bf3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c5345f1c1ec4bfa expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239805.802820:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb6018cf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758910464:0@lo:256: 00000100:00100000:1.0:1782239805.802859:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239805.803217:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5e8e80cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1782239805.803249:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758910464 00000100:00100000:3.0:1782239805.803254:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758910464 00000100:00100000:3.0:1782239805.803282:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1782239805.803289:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d1baf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+17:5787:x1868813758910464:12345-0@lo:256: 20000000:01000000:3.0:1782239805.803305:0:5783:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1782239805.803322:0:5783:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1782239805.803325:0:5783:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1782239805.803484:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d1baf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+17:5787:x1868813758910464:12345-0@lo:256: Request processed in 195us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239805.803495:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1782239805.807607:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb6018cf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758910464:0@lo:256: 10000000:01000000:1.0:1782239805.807670:0:5787:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1782239805.807681:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5c1676e00/0x8c5345f1c1ec4bf3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4bfa expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239805.807692:0:5787:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff9bb5c1676e00/0x8c5345f1c1ec4bf3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4bfa expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782239805.807701:0:5787:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1782239805.807704:0:5787:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:1.0:1782239805.807711:0:5787:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1782239805.807854:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5c1676000/0x8c5345f1c1ec4c01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239805.807865:0:5787:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: ffff9bb5c1676000/0x8c5345f1c1ec4c01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239805.807875:0:5787:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff9bb5c1676000/0x8c5345f1c1ec4c01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239805.807894:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb6018cf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758910592:0@lo:101: 00000100:00100000:1.0:1782239805.807952:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239805.808110:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5e8e80cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1782239805.810266:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758910592 00000100:00100000:2.0:1782239805.810278:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758910592 00000100:00100000:0.0:1782239805.812972:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1782239805.812986:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d1bae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+17:5787:x1868813758910592:12345-0@lo:101: 00010000:00010000:0.0:1782239805.813005:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782239805.813022:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb5c0031400/0x8c5345f1c1ec4c08 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c5345f1c1ec4c01 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239805.813049:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb5c0031400/0x8c5345f1c1ec4c08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4c01 expref: 18 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239805.813061:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb5c0031400/0x8c5345f1c1ec4c08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4c01 expref: 18 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239805.813070:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5c0031400, rc 0) 00000100:00100000:0.0:1782239805.813263:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d1bae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+18:5787:x1868813758910592:12345-0@lo:101: Request processed in 279us (5310us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239805.813271:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1782239805.813379:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb6018cf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758910592:0@lo:101: 00010000:00010000:2.0:1782239805.813399:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff9bb5c1676000/0x8c5345f1c1ec4c01 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4c08 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239805.813408:0:5787:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff9bb5c1676000/0x8c5345f1c1ec4c01 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c5345f1c1ec4c08 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239805.813476:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f48c2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758910720:0@lo:501: 00000100:00100000:2.0:1782239805.813510:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239805.813548:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c84b9240 going to sleep for 11 seconds 00000100:00100000:0.0:1782239805.813597:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758910720 00000100:00100000:0.0:1782239805.813603:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758910720 00000100:00100000:0.0:1782239805.813635:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1782239805.813642:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5decbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+18:5787:x1868813758910720:12345-0@lo:501: 00000100:00100000:0.0:1782239805.814929:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5decbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+18:5787:x1868813758910720:12345-0@lo:501: Request processed in 1280us (1411us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239805.814940:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1782239805.815039:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f48c2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758910720:0@lo:501: 00000100:00100000:2.0:1782239805.815080:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f48c2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758910848:0@lo:503: 00000100:00100000:2.0:1782239805.815140:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239805.815183:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c84b9240 going to sleep for 11 seconds 00000100:00100000:0.0:1782239805.815285:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758910848 00000100:00100000:0.0:1782239805.815291:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758910848 00000100:00100000:0.0:1782239805.815327:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1782239805.815334:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5decbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+18:5787:x1868813758910848:12345-0@lo:503: 00000100:00100000:0.0:1782239805.815635:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5decbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+18:5787:x1868813758910848:12345-0@lo:503: Request processed in 301us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239805.815642:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1782239805.815718:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f48c2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758910848:0@lo:503: 00000100:00100000:1.0:1782239805.819807:0:7866:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb6018cf480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:7866:1868813758910976:0@lo:502: 00000100:00100000:1.0:1782239805.819916:0:7866:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239805.819966:0:7866:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5e8e80480 going to sleep for 11 seconds 00000100:00100000:0.0:1782239805.820138:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758910976 00000100:00100000:0.0:1782239805.820147:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758910976 00000100:00100000:0.0:1782239805.820211:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1782239805.820221:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5decbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+18:7866:x1868813758910976:12345-0@lo:502: 00000100:00100000:0.0:1782239805.820564:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5decbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+18:7866:x1868813758910976:12345-0@lo:502: Request processed in 343us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239805.820572:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1782239805.820933:0:7866:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb6018cf480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:7866:1868813758910976:0@lo:502: 00000020:01000000:2.0:1782239805.820970:0:7866:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1782239805.820978:0:7866:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1782239805.820986:0:7866:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782239805.820989:0:7866:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1782239805.820993:0:7866:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1782239805.820998:0:7866:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.132@tcp to nid 0x20000c0a8cb84 (192.168.203.132@tcp) 00000020:01000000:2.0:1782239805.821021:0:7866:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1782239805.821024:0:7866:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1782239805.821051:0:7866:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9bb5ef7a8000) 00000020:00000080:2.0:1782239805.821077:0:7866:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1782239805.821084:0:7866:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1782239805.821176:0:7866:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1782239805.821182:0:7866:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:2.0:1782239805.821188:0:7866:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8c5345f1c1ec4c16 00010000:00080000:2.0:1782239805.821217:0:7866:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bb5fbba7800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.132@tcp at head 00010000:00010000:2.0:1782239805.821443:0:7866:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:2.0:1782239805.821725:0:7866:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1782239805.821738:0:7866:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1782239805.822310:0:7866:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1782239805.822501:0:7866:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1782239805.822544:0:7866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1782239805.822598:0:7866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1782239805.823341:0:7868:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1782239805.823345:0:7868:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1782239805.829700:0:7866:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1782239805.829718:0:7866:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1782239805.829950:0:7866:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1782239805.829976:0:7866:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8c5345f1c1ec4c1d 00000100:00080000:3.0:1782239805.829987:0:7866:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1782239805.829993:0:7866:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9bb5fbba7800 using connection 192.168.203.132@tcp/0@lo 00000100:00100000:3.0:1782239805.830034:0:7866:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bb601359c00 x1868813758911104/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1782239805.830055:0:7866:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:3.0:1782239805.830180:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb601359180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1868813758911232:0@lo:400: 00000100:00100000:3.0:1782239805.830261:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239805.830299:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782239805.830305:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb601358a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1868813758911360:0@lo:400: 00000100:00100000:3.0:1782239805.830328:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239805.830356:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb601359f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813758911488:0@lo:400: 00000100:00100000:3.0:1782239805.830383:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239805.830402:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782239805.830407:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb60135bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1868813758911616:0@lo:400: 00000100:00100000:3.0:1782239805.830428:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239805.830460:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758911232 00000100:00100000:3.0:1782239805.830468:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758911232 00000100:00100000:3.0:1782239805.830517:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758911360 00000100:00100000:3.0:1782239805.830520:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758911360 00000100:00100000:3.0:1782239805.830544:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758911616 00000100:00100000:3.0:1782239805.830547:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758911616 00000100:00100000:3.0:1782239805.830566:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1782239805.830575:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb60135a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1868813758911232:12345-0@lo:400: 00000100:00100000:3.0:1782239805.830646:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb60135a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1868813758911232:12345-0@lo:400: Request processed in 71us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239805.830654:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1782239805.830671:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1782239805.830678:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb601358700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1868813758911360:12345-0@lo:400: 00000100:00100000:3.0:1782239805.830707:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb601358700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1868813758911360:12345-0@lo:400: Request processed in 30us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239805.830713:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1782239805.830724:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1782239805.830732:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb60135a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1868813758911616:12345-0@lo:400: 00000100:00100000:3.0:1782239805.830799:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb60135a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1868813758911616:12345-0@lo:400: Request processed in 68us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239805.830805:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1782239805.830826:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758911488 00000100:00100000:3.0:1782239805.830830:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758911488 00000100:00100000:3.0:1782239805.830856:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1782239805.830863:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb60135aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1868813758911488:12345-0@lo:400: 00000100:00100000:3.0:1782239805.830895:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb60135aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1868813758911488:12345-0@lo:400: Request processed in 32us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239805.830900:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1782239805.830922:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782239805.830926:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1782239805.830954:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb60135bb80 x1868813758911616/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782239821 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782239805.830967:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb60135bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1868813758911616:0@lo:400: 00010000:00080000:3.0:1782239805.830978:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb601359f80 x1868813758911488/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782239821 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782239805.830992:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb601359f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813758911488:0@lo:400: 00010000:00080000:3.0:1782239805.831027:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb601358a80 x1868813758911360/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782239821 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782239805.831034:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb601358a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1868813758911360:0@lo:400: 00010000:00080000:3.0:1782239805.831043:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb601359180 x1868813758911232/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782239821 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782239805.831051:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb601359180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1868813758911232:0@lo:400: 00000020:01000000:3.0:1782239805.831107:0:7866:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782239805.831113:0:7866:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782239805.831115:0:7866:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1782239805.831120:0:7866:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782239805.831124:0:7866:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782239805.831125:0:7866:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:3.0:1782239805.831128:0:7866:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1782239805.831130:0:7866:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1782239805.831157:0:7866:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb601359180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:7866:1868813758911744:0@lo:502: 00000100:00100000:3.0:1782239805.831217:0:7866:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239805.831246:0:7866:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c84b8480 going to sleep for 11 seconds 00000100:00100000:2.0:1782239805.831475:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758911744 00000100:00100000:2.0:1782239805.831481:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758911744 00000100:00100000:2.0:1782239805.831509:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1782239805.831516:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5decbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+18:7866:x1868813758911744:12345-0@lo:502: 00000100:00100000:2.0:1782239805.831829:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5decbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+18:7866:x1868813758911744:12345-0@lo:502: Request processed in 312us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239805.831836:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1782239805.831944:0:7866:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb601359180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:7866:1868813758911744:0@lo:502: 00000020:01000000:3.0:1782239805.831970:0:7866:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782239805.831975:0:7866:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782239805.831977:0:7866:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:3.0:1782239805.831980:0:7866:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:3.0:1782239805.832034:0:5787:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:3.0:1782239805.832055:0:5787:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1782239805.832065:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5c1676000/0x8c5345f1c1ec4c01 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4c08 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239805.832084:0:5787:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff9bb5c1676000/0x8c5345f1c1ec4c01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4c08 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782239805.832095:0:5787:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1782239805.832098:0:5787:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff9bb5d1bd99c0 from 1 10000000:01000000:3.0:1782239805.832101:0:5787:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00000100:00100000:0.0:1782239805.832237:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb601359c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1868813758911104:0@lo:8: 00000100:00100000:0.0:1782239805.832280:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239805.832324:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758911104 00000100:00100000:0.0:1782239805.832329:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758911104 00000100:00100000:0.0:1782239805.832353:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1782239805.832359:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5dee27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3303:x1868813758911104:12345-0@lo:8: 00010000:00080000:0.0:1782239805.832393:0:6588:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 184 last 0 00000020:00000080:0.0:1782239805.832428:0:6588:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8c5345f1c1ec4c24 00002000:00100000:0.0:1782239805.832442:0:6588:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9bb601374000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113653 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1782239805.832446:0:6588:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:0.0:1782239805.832450:0:6588:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1782239805.832570:0:6588:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1782239805.832723:0:6588:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00010000:00010000:3.0:1782239805.832920:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a45400/0x8c5345f1c1ec4c2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239805.832931:0:5787:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a45400/0x8c5345f1c1ec4c2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239805.832941:0:5787:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a45400/0x8c5345f1c1ec4c2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239805.832958:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb601359180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758911872:0@lo:101: 00000100:00100000:3.0:1782239805.832996:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239805.833023:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c84b8480 going to sleep for 11 seconds 00000100:00100000:3.0:1782239805.833040:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758911872 00000100:00100000:3.0:1782239805.833045:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758911872 00000100:00100000:3.0:1782239805.833122:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1782239805.833131:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5decbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+18:5787:x1868813758911872:12345-0@lo:101: 00010000:00010000:3.0:1782239805.833145:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782239805.833160:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb5c2a44a00/0x8c5345f1c1ec4c32 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c5345f1c1ec4c2b expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239805.833192:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb5c2a44a00/0x8c5345f1c1ec4c32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4c2b expref: 19 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239805.833214:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb5c2a44a00/0x8c5345f1c1ec4c32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4c2b expref: 19 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239805.833223:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5c2a44a00, rc 0) 00000100:00100000:3.0:1782239805.833257:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5decbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:5787:x1868813758911872:12345-0@lo:101: Request processed in 126us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239805.833264:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:0.0:1782239805.833333:0:6588:0:(import.c:65:import_set_state_nolock()) ffff9bb601377000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782239805.833379:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5dee27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3303:x1868813758911104:12345-0@lo:8: Request processed in 1018us (1098us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239805.833387:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1782239805.833424:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb601359c00 x1868813758911104/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1782239815 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782239805.833435:0:3303:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1782239805.833443:0:3303:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1782239805.833451:0:3303:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1782239805.833457:0:3303:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1782239805.833460:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9bb5fbba7800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1782239805.833473:0:3303:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1782239805.833479:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb601359c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1868813758911104:0@lo:8: 00000004:00080000:0.0:1782239805.833505:0:7868:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1782239805.833619:0:7868:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 184905870319ns, next at 0ns, rc = 0 00000100:00100000:3.0:1782239805.834233:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb601359180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758911872:0@lo:101: 00010000:00010000:3.0:1782239805.834253:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a45400/0x8c5345f1c1ec4c2b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4c32 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239805.834265:0:5787:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a45400/0x8c5345f1c1ec4c2b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c5345f1c1ec4c32 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239805.834331:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb601359180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758912000:0@lo:501: 00000100:00100000:3.0:1782239805.834376:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239805.834414:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c84b8480 going to sleep for 11 seconds 00000100:00100000:2.0:1782239805.835923:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758912000 00000100:00100000:2.0:1782239805.835939:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758912000 00000100:00100000:2.0:1782239805.836007:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1782239805.836020:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5decbc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:5787:x1868813758912000:12345-0@lo:501: 00000100:00100000:2.0:1782239805.837380:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5decbc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:5787:x1868813758912000:12345-0@lo:501: Request processed in 1357us (2997us total) trans 0 rc -2/-2 00000100:00100000:2.0:1782239805.837393:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1782239805.837547:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb601359180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758912000:0@lo:501: 10000000:01000000:3.0:1782239805.837594:0:5787:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1782239805.837604:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a45400/0x8c5345f1c1ec4c2b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4c32 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239805.837613:0:5787:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a45400/0x8c5345f1c1ec4c2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4c32 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782239805.879827:0:5812:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:2.0:1782239805.879930:0:7869:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:2.0:1782239805.879960:0:7869:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f48c0e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7869:1868813758912256:0@lo:7: 00000100:00100000:2.0:1782239805.880033:0:7869:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239805.880085:0:7869:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5d135c240 going to sleep for 11 seconds 00000100:00100000:2.0:1782239805.880105:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f48c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1868813758912128:0@lo:13: 00000100:00100000:2.0:1782239805.880144:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239805.880200:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758912256 00000100:00100000:2.0:1782239805.880207:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758912256 00000100:00100000:2.0:1782239805.880266:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1782239805.880277:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7869:x1868813758912256:12345-0@lo:7: 00000100:00080000:3.0:1782239805.883802:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782239805.883935:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758912128 00000100:00100000:0.0:1782239805.883947:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758912128 00000100:00100000:0.0:1782239805.884003:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1782239805.884013:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1868813758912128:12345-0@lo:13: 00002000:00000024:0.0:1782239805.884056:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1782239805.884176:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1868813758912128:12345-0@lo:13: Request processed in 155us (4021us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239805.884184:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1782239805.884335:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb5f48c2a00 x1868813758912128/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782239821 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782239805.884356:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f48c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1868813758912128:0@lo:13: 00002000:00080000:2.0:1782239805.887951:0:6589:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:2.0:1782239805.887960:0:6589:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:2.0:1782239805.888133:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7869:x1868813758912256:12345-0@lo:7: Request processed in 7853us (8095us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239805.888144:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1782239805.888286:0:7869:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb5f48c0e00 x1868813758912256/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1782239821 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782239805.888303:0:7869:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f48c0e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7869:1868813758912256:0@lo:7: 00000004:00080000:0.0:1782239805.888317:0:7869:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1782239805.888356:0:7869:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5dee26300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7869:1868813758912384:0@lo:5: 00000100:00100000:0.0:1782239805.888391:0:7869:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239805.888490:0:7869:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5f7cbde40 going to sleep for 11 seconds 00000100:00100000:3.0:1782239805.888703:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758912384 00000100:00100000:3.0:1782239805.888710:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758912384 00000100:00100000:2.0:1782239805.889090:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1782239805.889101:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5dee26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7869:x1868813758912384:12345-0@lo:5: 00002000:00080000:2.0:1782239805.889137:0:6590:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1782239805.889141:0:6590:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1782239805.889453:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5dee26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:7869:x1868813758912384:12345-0@lo:5: Request processed in 353us (1061us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1782239805.889461:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1782239805.889551:0:7869:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb5dee26300 x1868813758912384/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1782239821 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782239805.889565:0:7869:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5dee26300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7869:1868813758912384:0@lo:5: 00000004:00080000:1.0:1782239805.889579:0:7869:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:1.0:1782239805.889612:0:7869:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb6018cd500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7869:1868813758912512:0@lo:700: 00000100:00100000:1.0:1782239805.889646:0:7869:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239805.889668:0:7869:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5e8e80f00 going to sleep for 11 seconds 00000100:00100000:1.0:1782239805.889686:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758912512 00000100:00100000:1.0:1782239805.889690:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758912512 00000100:00100000:1.0:1782239805.889727:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782239805.889734:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb6018cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7869:x1868813758912512:12345-0@lo:700: 00000100:00100000:1.0:1782239805.889804:0:6597:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb6018ce300 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6597:1868813758912640:0@lo:700: 00000100:00100000:1.0:1782239805.889833:0:6597:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239805.889849:0:6597:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5e8e80c00 going to sleep for 11 seconds 00000100:00100000:1.0:1782239805.889863:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758912640 00000100:00100000:1.0:1782239805.889865:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758912640 00000100:00100000:1.0:1782239805.889893:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782239805.889900:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb6018cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6597:x1868813758912640:12345-0@lo:700: 40000000:02000000:0.0:1782239805.920129:0:5797:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:0.0:1782239805.926285:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb6018cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6597:x1868813758912640:12345-0@lo:700: Request processed in 36379us (36444us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239805.926301:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1782239805.928303:0:6597:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb6018ce300 x1868813758912640/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1782239821 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782239805.928322:0:6597:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb6018ce300 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6597:1868813758912640:0@lo:700: 40000000:02000000:2.0:1782239805.928337:0:6597:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000100:00100000:2.0:1782239806.025361:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb6018cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7869:x1868813758912512:12345-0@lo:700: Request processed in 135617us (135703us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239806.025378:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000001:00100000:2.0:1782239806.025416:0:7493:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1782239806.025434:0:7493:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00010000:00080000:2.0:1782239806.025723:0:7869:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb6018cd500 x1868813758912512/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1782239821 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782239806.025739:0:7869:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb6018cd500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7869:1868813758912512:0@lo:700: 00000004:02000040:2.0:1782239806.084191:0:7869:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:2.0:1782239806.091496:0:7869:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f48c0e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7869:1868813758912768:0@lo:5: 00000100:00100000:2.0:1782239806.091567:0:7869:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239806.091622:0:7869:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5d135c240 going to sleep for 11 seconds 00000100:00100000:1.0:1782239806.091783:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758912768 00000100:00100000:1.0:1782239806.091792:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758912768 00000100:00100000:1.0:1782239806.091843:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1782239806.091853:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:7869:x1868813758912768:12345-0@lo:5: 00002000:00080000:0.0:1782239806.102074:0:6589:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1782239806.102097:0:6589:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:0.0:1782239806.116663:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7869:x1868813758912768:12345-0@lo:5: Request processed in 24802us (25087us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1782239806.116676:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1782239806.119322:0:7869:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb5f48c0e00 x1868813758912768/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1782239822 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782239806.119340:0:7869:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1782239806.119357:0:7869:0:(client.c:3155:ptlrpc_free_committed()) @@@ stopping search req@ffff9bb5f48c0e00 x1868813758912768/t4294967298(4294967298) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1782239822 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782239806.119368:0:7869:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f48c0e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7869:1868813758912768:0@lo:5: 00000004:00080000:3.0:1782239806.119382:0:7869:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:3.0:1782239806.687104:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782239807.711138:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782239808.735323:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782239809.760360:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782239809.836882:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782239809.836918:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb601359180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1868813758912896:0@lo:13: 00000100:00100000:0.0:1782239809.837031:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239809.839913:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758912896 00000100:00100000:3.0:1782239809.840248:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758912896 00000100:00100000:3.0:1782239809.840397:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1782239809.840411:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5dee24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1868813758912896:12345-0@lo:13: 00002000:00000024:3.0:1782239809.840463:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782239809.840568:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5dee24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1868813758912896:12345-0@lo:13: Request processed in 160us (3537us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239809.840576:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1782239809.840877:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb601359180 x1868813758912896/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782239825 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782239809.840903:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb601359180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1868813758912896:0@lo:13: 00000100:00080000:2.0:1782239809.842552:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1782239810.672168:0:7493:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:0.0:1782239810.784339:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782239810.867300:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782239810.867327:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fbf25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3307:1868813758913024:0@lo:400: 00000100:00100000:2.0:1782239810.867396:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239810.867551:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758913024 00000100:00100000:2.0:1782239810.867559:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758913024 00000100:00100000:2.0:1782239810.867605:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1782239810.867614:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5decbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:3307:x1868813758913024:12345-0@lo:400: 00000100:00100000:2.0:1782239810.867667:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5decbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:3307:x1868813758913024:12345-0@lo:400: Request processed in 53us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239810.867674:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1782239810.867732:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fbf25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3307:1868813758913024:0@lo:400: 00000100:00100000:2.0:1782239810.867786:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fbf25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1868813758913152:0@lo:400: 00000100:00100000:2.0:1782239810.867813:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239810.867853:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758913152 00000100:00100000:2.0:1782239810.867858:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758913152 00000100:00100000:2.0:1782239810.867884:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1782239810.867890:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fbf26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1868813758913152:12345-0@lo:400: 00000100:00100000:2.0:1782239810.867926:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fbf26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1868813758913152:12345-0@lo:400: Request processed in 36us (112us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239810.867931:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:2.0:1782239810.867959:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb5fbf25180 x1868813758913152/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782239826 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782239810.867970:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fbf25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1868813758913152:0@lo:400: 00000100:00100000:2.0:1782239810.868003:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782239810.868010:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fbf25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1868813758913280:0@lo:400: 00000100:00100000:2.0:1782239810.868031:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239810.868054:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758913280 00000100:00100000:2.0:1782239810.868057:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758913280 00000100:00100000:2.0:1782239810.868086:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1782239810.868092:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fbf25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1868813758913280:12345-0@lo:400: 00000100:00100000:2.0:1782239810.868125:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fbf25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1868813758913280:12345-0@lo:400: Request processed in 34us (93us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239810.868141:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1782239810.868157:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1782239810.868176:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb5fbf25180 x1868813758913280/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782239826 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782239810.868185:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fbf25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1868813758913280:0@lo:400: 00000100:00100000:2.0:1782239810.868214:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fbf25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813758913408:0@lo:400: 00000100:00100000:2.0:1782239810.868239:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239810.868279:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758913408 00000100:00100000:2.0:1782239810.868283:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758913408 00000100:00100000:2.0:1782239810.868305:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1782239810.868311:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fbf25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1868813758913408:12345-0@lo:400: 00000100:00100000:2.0:1782239810.868346:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fbf25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1868813758913408:12345-0@lo:400: Request processed in 35us (107us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239810.868351:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1782239810.868373:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb5fbf25180 x1868813758913408/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782239826 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782239810.868382:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fbf25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813758913408:0@lo:400: 00000100:00100000:2.0:1782239810.868420:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782239810.868426:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fbf25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1868813758913536:0@lo:400: 00000100:00100000:2.0:1782239810.868447:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239810.868465:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758913536 00000100:00100000:2.0:1782239810.868468:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758913536 00000100:00100000:2.0:1782239810.868494:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1782239810.868500:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fbf27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1868813758913536:12345-0@lo:400: 00000100:00100000:2.0:1782239810.868531:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fbf27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1868813758913536:12345-0@lo:400: Request processed in 31us (83us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239810.868536:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:2.0:1782239810.868549:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1782239810.868566:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb5fbf25180 x1868813758913536/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782239826 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782239810.868576:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fbf25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1868813758913536:0@lo:400: 00000100:00100000:2.0:1782239810.868604:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fbf25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1868813758913664:0@lo:400: 00000100:00100000:2.0:1782239810.868626:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239810.872084:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758913664 00000100:00100000:0.0:1782239810.872099:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758913664 00000100:00100000:0.0:1782239810.872169:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1782239810.872181:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fbf26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1868813758913664:12345-0@lo:400: 00000100:00100000:0.0:1782239810.872272:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fbf26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1868813758913664:12345-0@lo:400: Request processed in 94us (3644us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239810.872280:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1782239810.872328:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb5fbf25180 x1868813758913664/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782239826 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782239810.872341:0:3307:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1782239810.872359:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fbf25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1868813758913664:0@lo:400: 00000100:00080000:2.0:1782239810.873141:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782239811.359725:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb601358a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1868813758913792:0@lo:13: 00000100:00100000:2.0:1782239811.359811:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239811.359868:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758913792 00000100:00100000:3.0:1782239811.359875:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758913792 00000100:00100000:3.0:1782239811.359929:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1782239811.360048:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fbf24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1868813758913792:12345-0@lo:13: 00000100:00100000:0.0:1782239811.368277:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239811.368311:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737918592 00000100:00100000:0.0:1782239811.368320:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737918592 00000100:00100000:0.0:1782239811.368356:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 111 00000100:00100000:0.0:1782239811.368364:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5decbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2343:x1868813737918592:12345-192.168.203.32@tcp:250: 00010000:00080000:0.0:1782239811.368395:0:5784:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from afaefb1a-536b-42a3-a3ff-47200f8611c3@192.168.203.32@tcp t0 exp 0000000000000000 cur 190 last 0 00000020:00000080:0.0:1782239811.368423:0:5784:0:(genops.c:1406:class_connect()) connect: client afaefb1a-536b-42a3-a3ff-47200f8611c3, cookie 0x8c5345f1c1ec4c39 00000100:00080000:0.0:1782239811.368556:0:5784:0:(import.c:65:import_set_state_nolock()) ffff9bb601372000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782239811.368620:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5decbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afaefb1a-536b-42a3-a3ff-47200f8611c3+5:2343:x1868813737918592:12345-192.168.203.32@tcp:250: Request processed in 255us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239811.368627:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 111 00002000:00000024:2.0:1782239811.369502:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782239811.369576:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fbf24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1868813758913792:12345-0@lo:13: Request processed in 9636us (9763us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239811.369586:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1782239811.369673:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb601358a80 x1868813758913792/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782239827 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782239811.369707:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb601358a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1868813758913792:0@lo:13: 00000100:00100000:0.0:1782239811.372298:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239811.372670:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737918720 00000100:00100000:2.0:1782239811.372679:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737918720 00000100:00100000:2.0:1782239811.372734:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 112 00000100:00100000:2.0:1782239811.372744:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5decbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afaefb1a-536b-42a3-a3ff-47200f8611c3+5:5553:x1868813737918720:12345-192.168.203.32@tcp:101: 00010000:00010000:2.0:1782239811.372798:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782239811.372816:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb602045e00/0x8c5345f1c1ec4c40 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e373 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239811.372844:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb602045e00/0x8c5345f1c1ec4c40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e373 expref: 6 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239811.372856:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb602045e00/0x8c5345f1c1ec4c40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e373 expref: 6 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239811.372865:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb602045e00, rc 0) 00000100:00100000:2.0:1782239811.372922:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5decbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afaefb1a-536b-42a3-a3ff-47200f8611c3+6:5553:x1868813737918720:12345-192.168.203.32@tcp:101: Request processed in 180us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239811.372930:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 112 00000100:00100000:3.0:1782239811.377032:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239811.377336:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737918848 00000100:00100000:0.0:1782239811.377357:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737918848 00000100:00100000:0.0:1782239811.377407:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 113 00000100:00100000:0.0:1782239811.377415:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5decbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afaefb1a-536b-42a3-a3ff-47200f8611c3+6:5553:x1868813737918848:12345-192.168.203.32@tcp:501: 00000100:00100000:0.0:1782239811.377788:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5decbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afaefb1a-536b-42a3-a3ff-47200f8611c3+6:5553:x1868813737918848:12345-192.168.203.32@tcp:501: Request processed in 372us (1360us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782239811.377796:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 113 00000100:00100000:3.0:1782239811.387157:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239811.387278:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737918976 00000100:00100000:0.0:1782239811.387288:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737918976 00000100:00100000:0.0:1782239811.387395:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 114 00000100:00100000:0.0:1782239811.387404:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5decbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afaefb1a-536b-42a3-a3ff-47200f8611c3+6:5553:x1868813737918976:12345-192.168.203.32@tcp:101: 00010000:00010000:0.0:1782239811.387420:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782239811.387444:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb5c0031800/0x8c5345f1c1ec4c47 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e37a expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239811.387471:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb5c0031800/0x8c5345f1c1ec4c47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e37a expref: 7 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239811.387482:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb5c0031800/0x8c5345f1c1ec4c47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e37a expref: 7 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239811.387492:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5c0031800, rc 0) 00000100:00100000:0.0:1782239811.387548:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5decbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afaefb1a-536b-42a3-a3ff-47200f8611c3+7:5553:x1868813737918976:12345-192.168.203.32@tcp:101: Request processed in 144us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239811.387556:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 114 00000100:00100000:0.0:1782239811.393140:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239811.393225:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737919104 00000100:00100000:2.0:1782239811.393236:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737919104 00000100:00100000:2.0:1782239811.393291:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 115 00000100:00100000:2.0:1782239811.393300:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5decbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afaefb1a-536b-42a3-a3ff-47200f8611c3+7:5553:x1868813737919104:12345-192.168.203.32@tcp:501: 00000100:00100000:2.0:1782239811.394244:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5decbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afaefb1a-536b-42a3-a3ff-47200f8611c3+8:5553:x1868813737919104:12345-192.168.203.32@tcp:501: Request processed in 940us (1119us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239811.394254:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 115 00000100:00100000:3.0:1782239811.415420:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239811.415927:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737919232 00000100:00100000:0.0:1782239811.415947:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737919232 00000100:00100000:0.0:1782239811.416006:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 116 00000100:00100000:0.0:1782239811.416029:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5decbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afaefb1a-536b-42a3-a3ff-47200f8611c3+8:5553:x1868813737919232:12345-192.168.203.32@tcp:503: 00000100:00100000:0.0:1782239811.416881:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5decbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afaefb1a-536b-42a3-a3ff-47200f8611c3+8:5553:x1868813737919232:12345-192.168.203.32@tcp:503: Request processed in 848us (1464us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239811.416891:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 116 00000100:00100000:2.0:1782239811.426824:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239811.426964:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737919360 00000100:00100000:3.0:1782239811.426973:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737919360 00000100:00100000:3.0:1782239811.427030:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 117 00000100:00100000:3.0:1782239811.427040:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5decbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afaefb1a-536b-42a3-a3ff-47200f8611c3+8:5571:x1868813737919360:12345-192.168.203.32@tcp:502: 00000100:00100000:3.0:1782239811.427391:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5decbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afaefb1a-536b-42a3-a3ff-47200f8611c3+8:5571:x1868813737919360:12345-192.168.203.32@tcp:502: Request processed in 351us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239811.427410:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 117 00000100:00100000:0.0:1782239811.481168:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239811.481283:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737919488 00000100:00100000:2.0:1782239811.481293:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737919488 00000100:00100000:2.0:1782239811.481352:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 118 00000100:00100000:2.0:1782239811.481362:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5decbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afaefb1a-536b-42a3-a3ff-47200f8611c3+8:5571:x1868813737919488:12345-192.168.203.32@tcp:502: 00000100:00100000:2.0:1782239811.482935:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5decbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afaefb1a-536b-42a3-a3ff-47200f8611c3+8:5571:x1868813737919488:12345-192.168.203.32@tcp:502: Request processed in 1565us (1767us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239811.482949:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 118 00000100:00100000:1.0:1782239811.497338:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239811.497440:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737919616 00000100:00100000:2.0:1782239811.497449:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737919616 00000100:00100000:2.0:1782239811.497509:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 119 00000100:00100000:2.0:1782239811.497520:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5decbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afaefb1a-536b-42a3-a3ff-47200f8611c3+8:5553:x1868813737919616:12345-192.168.203.32@tcp:101: 00010000:00010000:2.0:1782239811.497538:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782239811.497555:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb602045400/0x8c5345f1c1ec4c4e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e3a4 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239811.497849:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb602045400/0x8c5345f1c1ec4c4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e3a4 expref: 9 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239811.497860:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb602045400/0x8c5345f1c1ec4c4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e3a4 expref: 9 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239811.497868:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb602045400, rc 0) 00000100:00100000:2.0:1782239811.498060:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5decbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afaefb1a-536b-42a3-a3ff-47200f8611c3+9:5553:x1868813737919616:12345-192.168.203.32@tcp:101: Request processed in 541us (731us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239811.498081:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 119 00000100:00100000:0.0:1782239811.508144:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239811.508406:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737919744 00000100:00100000:3.0:1782239811.508417:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737919744 00000100:00100000:3.0:1782239811.508475:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 120 00000100:00100000:3.0:1782239811.508483:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d0330050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afaefb1a-536b-42a3-a3ff-47200f8611c3+9:5553:x1868813737919744:12345-192.168.203.32@tcp:256: 20000000:01000000:3.0:1782239811.508507:0:5785:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1782239811.508529:0:5785:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1782239811.508532:0:5785:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1782239811.508535:0:5785:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1782239811.508537:0:5785:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1782239811.510474:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d0330050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afaefb1a-536b-42a3-a3ff-47200f8611c3+9:5553:x1868813737919744:12345-192.168.203.32@tcp:256: Request processed in 1980us (2336us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239811.510488:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 120 00000100:00100000:1.0:1782239811.516150:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239811.516244:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737919872 00000100:00100000:2.0:1782239811.516254:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737919872 00000100:00100000:2.0:1782239811.516315:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 121 00000100:00100000:2.0:1782239811.516325:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d0330c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afaefb1a-536b-42a3-a3ff-47200f8611c3+9:5553:x1868813737919872:12345-192.168.203.32@tcp:101: 00010000:00010000:2.0:1782239811.516342:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782239811.516360:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb602044a00/0x8c5345f1c1ec4c55 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e3ab expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239811.516388:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb602044a00/0x8c5345f1c1ec4c55 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e3ab expref: 10 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239811.516399:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb602044a00/0x8c5345f1c1ec4c55 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e3ab expref: 10 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239811.516416:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb602044a00, rc 0) 00000100:00100000:2.0:1782239811.519132:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d0330c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afaefb1a-536b-42a3-a3ff-47200f8611c3+10:5553:x1868813737919872:12345-192.168.203.32@tcp:101: Request processed in 2789us (2973us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239811.519146:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 121 00000100:00100000:0.0:1782239811.522677:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239811.522888:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737920000 00000100:00100000:3.0:1782239811.522897:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737920000 00000100:00100000:3.0:1782239811.522953:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 122 00000100:00100000:3.0:1782239811.522986:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d0330450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afaefb1a-536b-42a3-a3ff-47200f8611c3+10:5553:x1868813737920000:12345-192.168.203.32@tcp:501: 00000100:00100000:3.0:1782239811.524074:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d0330450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afaefb1a-536b-42a3-a3ff-47200f8611c3+10:5553:x1868813737920000:12345-192.168.203.32@tcp:501: Request processed in 1086us (1403us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239811.524086:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 122 00000100:00100000:3.0:1782239811.531342:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239811.531684:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737920128 00000100:00100000:0.0:1782239811.531694:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737920128 00000100:00100000:0.0:1782239811.531788:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 123 00000100:00100000:0.0:1782239811.531798:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d0333c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afaefb1a-536b-42a3-a3ff-47200f8611c3+10:5553:x1868813737920128:12345-192.168.203.32@tcp:503: 00000100:00100000:0.0:1782239811.532180:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d0333c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afaefb1a-536b-42a3-a3ff-47200f8611c3+10:5553:x1868813737920128:12345-192.168.203.32@tcp:503: Request processed in 383us (847us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239811.532189:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 123 00000100:00100000:1.0:1782239811.535897:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239811.536219:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737920256 00000100:00100000:3.0:1782239811.536229:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737920256 00000100:00100000:3.0:1782239811.536288:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 124 00000100:00100000:3.0:1782239811.536299:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d0333850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afaefb1a-536b-42a3-a3ff-47200f8611c3+10:5575:x1868813737920256:12345-192.168.203.32@tcp:502: 00000100:00100000:3.0:1782239811.536718:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d0333850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afaefb1a-536b-42a3-a3ff-47200f8611c3+10:5575:x1868813737920256:12345-192.168.203.32@tcp:502: Request processed in 418us (827us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239811.536727:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 124 00000100:00100000:1.0:1782239811.555732:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239811.562157:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737920384 00000100:00100000:2.0:1782239811.562172:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737920384 00000100:00100000:2.0:1782239811.562322:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 125 00000100:00100000:2.0:1782239811.562335:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d0332050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afaefb1a-536b-42a3-a3ff-47200f8611c3+10:5575:x1868813737920384:12345-192.168.203.32@tcp:502: 00000100:00100000:2.0:1782239811.562625:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d0332050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afaefb1a-536b-42a3-a3ff-47200f8611c3+10:5575:x1868813737920384:12345-192.168.203.32@tcp:502: Request processed in 292us (6951us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239811.562634:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 125 00000100:00100000:1.0:1782239811.569088:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239811.569369:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737920512 00000100:00100000:2.0:1782239811.569392:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737920512 00000100:00100000:2.0:1782239811.569486:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 4 00000100:00100000:2.0:1782239811.569496:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb6018cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2343:x1868813737920512:12345-192.168.203.32@tcp:38: 00010000:00080000:2.0:1782239811.569526:0:5790:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 36dd742b-25b8-431e-bf41-75f2fff47ffb@192.168.203.32@tcp t0 exp 0000000000000000 cur 190 last 0 00000020:00000080:2.0:1782239811.569585:0:5790:0:(genops.c:1406:class_connect()) connect: client 36dd742b-25b8-431e-bf41-75f2fff47ffb, cookie 0x8c5345f1c1ec4c5c 00000004:00100000:2.0:1782239811.569616:0:5790:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1782239811.569622:0:5790:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:0.0:1782239811.622537:0:5790:0:(import.c:65:import_set_state_nolock()) ffff9bb601370800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782239811.622634:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb6018cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+6:2343:x1868813737920512:12345-192.168.203.32@tcp:38: Request processed in 53136us (53553us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239811.622645:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 4 00010000:00010000:1.0:1782239811.808606:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782239812.636789:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239812.636858:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239812.637032:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737920640 00000100:00100000:0.0:1782239812.637043:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737920640 00000100:00100000:0.0:1782239812.637125:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737920768 00000100:00100000:0.0:1782239812.637129:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737920768 00000100:00100000:0.0:1782239812.637156:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 5 00000100:00100000:0.0:1782239812.637165:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb601358a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+7:0:x1868813737920640:12345-192.168.203.32@tcp:41: 00000004:00000024:0.0:1782239812.637212:0:5791:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1782239812.637278:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb601358a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+7:0:x1868813737920640:12345-192.168.203.32@tcp:41: Request processed in 114us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239812.637296:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 5 00000100:00100000:0.0:1782239812.637315:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 6 00000100:00100000:0.0:1782239812.637322:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb601359f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+6:5553:x1868813737920768:12345-192.168.203.32@tcp:41: 00000004:00000024:0.0:1782239812.637333:0:5791:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1782239812.637355:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb601359f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+6:5553:x1868813737920768:12345-192.168.203.32@tcp:41: Request processed in 34us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239812.637361:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 6 00000100:00080000:3.0:1782239812.639525:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782239812.650848:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239812.650981:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737920896 00000100:00100000:0.0:1782239812.650992:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737920896 00000100:00100000:0.0:1782239812.651056:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 7 00000100:00100000:0.0:1782239812.651067:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fbf24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+6:5553:x1868813737920896:12345-192.168.203.32@tcp:40: 00000100:00100000:0.0:1782239812.651170:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fbf24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+6:5553:x1868813737920896:12345-192.168.203.32@tcp:40: Request processed in 105us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239812.651178:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 7 00000100:00100000:1.0:1782239812.653079:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239812.653179:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737921152 00000100:00100000:0.0:1782239812.653188:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737921152 00000100:00100000:0.0:1782239812.653239:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 126 00000100:00100000:0.0:1782239812.653249:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d0333450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afaefb1a-536b-42a3-a3ff-47200f8611c3+10:2346:x1868813737921152:12345-192.168.203.32@tcp:400: 00000100:00100000:0.0:1782239812.653319:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d0333450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afaefb1a-536b-42a3-a3ff-47200f8611c3+10:2346:x1868813737921152:12345-192.168.203.32@tcp:400: Request processed in 70us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239812.653327:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 126 00000100:00100000:1.0:1782239812.656913:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239812.656952:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239812.656978:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239812.657040:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737921024 00000100:00100000:0.0:1782239812.657049:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737921024 00000100:00100000:0.0:1782239812.657084:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737921280 00000100:00100000:0.0:1782239812.657086:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737921280 00000100:00100000:0.0:1782239812.657113:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 8 00000100:00100000:0.0:1782239812.657130:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb6018cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2343:x1868813737921024:12345-192.168.203.32@tcp:8: 00010000:00080000:0.0:1782239812.657160:0:6589:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 36dd742b-25b8-431e-bf41-75f2fff47ffb@192.168.203.32@tcp t0 exp 0000000000000000 cur 191 last 0 00000020:00000080:0.0:1782239812.657191:0:6589:0:(genops.c:1406:class_connect()) connect: client 36dd742b-25b8-431e-bf41-75f2fff47ffb, cookie 0x8c5345f1c1ec4c63 00002000:00100000:0.0:1782239812.657202:0:6589:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 36dd742b-25b8-431e-bf41-75f2fff47ffb/ffff9bb5f4999000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1782239812.657226:0:6589:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1782239812.657545:0:6589:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1782239812.657573:0:6589:0:(import.c:65:import_set_state_nolock()) ffff9bb5f460e000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782239812.657630:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb6018cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+6:2343:x1868813737921024:12345-192.168.203.32@tcp:8: Request processed in 500us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239812.657637:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 8 00000100:00100000:0.0:1782239812.657654:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 9 00000100:00100000:0.0:1782239812.657659:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb6018ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2343:x1868813737921280:12345-192.168.203.32@tcp:8: 00010000:00080000:0.0:1782239812.657673:0:6589:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 36dd742b-25b8-431e-bf41-75f2fff47ffb@192.168.203.32@tcp t0 exp 0000000000000000 cur 191 last 0 00000020:00000080:0.0:1782239812.657688:0:6589:0:(genops.c:1406:class_connect()) connect: client 36dd742b-25b8-431e-bf41-75f2fff47ffb, cookie 0x8c5345f1c1ec4c6a 00002000:00100000:0.0:1782239812.657693:0:6589:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 36dd742b-25b8-431e-bf41-75f2fff47ffb/ffff9bb5f4609800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1782239812.657699:0:6589:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1782239812.658263:0:6589:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1782239812.658296:0:6589:0:(import.c:65:import_set_state_nolock()) ffff9bb5f460f000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782239812.658345:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb6018ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+6:2343:x1868813737921280:12345-192.168.203.32@tcp:8: Request processed in 683us (1365us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239812.658354:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 9 00000100:00100000:2.0:1782239812.658523:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737921408 00000100:00100000:2.0:1782239812.658530:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737921408 00000100:00100000:2.0:1782239812.658571:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 0 00000100:00100000:2.0:1782239812.658579:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb6018cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+6:5553:x1868813737921408:12345-192.168.203.32@tcp:33: 00000004:00080000:3.0:1782239812.707585:0:5793:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 48950us 00000004:00200000:2.0:1782239812.738324:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:2.0:1782239812.738521:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb6018cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+6:5553:x1868813737921408:12345-192.168.203.32@tcp:33: Request processed in 79935us (81610us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239812.738533:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 0 00010000:00010000:0.0:1782239812.830983:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782239812.934306:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239812.934405:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737921536 00000100:00100000:3.0:1782239812.934416:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737921536 00000100:00100000:3.0:1782239812.934478:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 8 00000100:00100000:3.0:1782239812.934488:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb6018cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+6:5592:x1868813737921536:12345-192.168.203.32@tcp:101: 00010000:00010000:3.0:1782239812.934510:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782239812.934536:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a45200/0x8c5345f1c1ec4c71 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e3d5 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239812.934598:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44600/0x8c5345f1c1ec4c78 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239812.934626:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44600/0x8c5345f1c1ec4c78 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239812.934639:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44600/0x8c5345f1c1ec4c78 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782239812.934887:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1782239812.934892:0:5792:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1782239812.934970:0:5792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44600/0x8c5345f1c1ec4c78 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239812.935000:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a45200/0x8c5345f1c1ec4c71 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e3d5 expref: 8 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239812.935016:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44600/0x8c5345f1c1ec4c78 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e3d5 expref: 7 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239812.935023:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bb5d0df4100) 00010000:00010000:3.0:1782239812.935026:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782239812.935029:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5c2a44600, rc 0) 00000100:00100000:3.0:1782239812.935091:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb6018cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+7:5592:x1868813737921536:12345-192.168.203.32@tcp:101: Request processed in 604us (806us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239812.935099:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 8 00000001:00100000:0.0:1782239813.489932:0:6614:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 36dd742b-25b8-431e-bf41-75f2fff47ffb 00010000:00010000:1.0:1782239813.856606:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782239814.878974:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782239814.943111:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb60135bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813758913920:0@lo:13: 00000100:00100000:2.0:1782239814.943198:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239814.943372:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758913920 00000100:00100000:3.0:1782239814.943380:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758913920 00000100:00100000:3.0:1782239814.943449:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1782239814.943459:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fbf24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1868813758913920:12345-0@lo:13: 00002000:00000024:3.0:1782239814.943497:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782239814.943566:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fbf24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1868813758913920:12345-0@lo:13: Request processed in 107us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239814.943573:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1782239814.943791:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb60135bb80 x1868813758913920/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782239830 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782239814.943823:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb60135bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813758913920:0@lo:13: 00000100:00080000:2.0:1782239814.944013:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782239815.337666:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239815.339284:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737921664 00000100:00100000:2.0:1782239815.339297:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737921664 00000100:00100000:2.0:1782239815.339411:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 9 00000100:00100000:2.0:1782239815.339425:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5dee25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+7:5644:x1868813737921664:12345-192.168.203.32@tcp:41: 00000004:00000024:2.0:1782239815.339471:0:5791:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1782239815.339550:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5dee25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+7:5644:x1868813737921664:12345-192.168.203.32@tcp:41: Request processed in 130us (1894us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239815.339577:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 9 00000100:00080000:3.0:1782239815.340018:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782239815.344287:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239815.344485:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737921792 00000100:00100000:3.0:1782239815.344493:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737921792 00000100:00100000:3.0:1782239815.344565:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 8 00000100:00100000:3.0:1782239815.344576:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb6018ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:36dd742b-25b8-431e-bf41-75f2fff47ffb+5:5644:x1868813737921792:12345-192.168.203.32@tcp:13: 00002000:00000024:3.0:1782239815.344602:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782239815.344661:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb6018ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:36dd742b-25b8-431e-bf41-75f2fff47ffb+5:5644:x1868813737921792:12345-192.168.203.32@tcp:13: Request processed in 87us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239815.344668:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 8 00000100:00080000:0.0:1782239815.344772:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782239815.361722:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239815.361825:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737921920 00000100:00100000:3.0:1782239815.361836:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737921920 00000100:00100000:3.0:1782239815.361903:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 9 00000100:00100000:3.0:1782239815.361915:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb6018cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:36dd742b-25b8-431e-bf41-75f2fff47ffb+6:5644:x1868813737921920:12345-192.168.203.32@tcp:13: 00002000:00000024:3.0:1782239815.361954:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782239815.362035:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb6018cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:36dd742b-25b8-431e-bf41-75f2fff47ffb+6:5644:x1868813737921920:12345-192.168.203.32@tcp:13: Request processed in 123us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239815.362042:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 9 00000100:00080000:0.0:1782239815.362213:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1782239815.903967:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782239815.971870:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5dee26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3306:1868813758914048:0@lo:400: 00000100:00100000:1.0:1782239815.971948:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239815.972158:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5dee24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1868813758914176:0@lo:400: 00000100:00100000:2.0:1782239815.972191:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239815.972213:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f48c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1868813758914688:0@lo:400: 00000100:00100000:2.0:1782239815.972236:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239815.972253:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782239815.972258:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5dee25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1868813758914560:0@lo:400: 00000100:00100000:2.0:1782239815.972293:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239815.972324:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758914048 00000100:00100000:2.0:1782239815.972331:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758914048 00000100:00100000:2.0:1782239815.972377:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1782239815.972387:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d0332450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:3306:x1868813758914048:12345-0@lo:400: 00000100:00100000:2.0:1782239815.972446:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d0332450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:3306:x1868813758914048:12345-0@lo:400: Request processed in 49us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239815.972454:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1782239815.972489:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758914176 00000100:00100000:2.0:1782239815.972494:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758914176 00000100:00100000:2.0:1782239815.972521:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758914560 00000100:00100000:2.0:1782239815.972524:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758914560 00000100:00100000:2.0:1782239815.972559:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1782239815.972566:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fbf26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1868813758914176:12345-0@lo:400: 00000100:00100000:2.0:1782239815.972601:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fbf26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1868813758914176:12345-0@lo:400: Request processed in 36us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239815.972608:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1782239815.972620:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1782239815.972626:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fbf24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1868813758914560:12345-0@lo:400: 00000100:00100000:2.0:1782239815.972668:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fbf24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1868813758914560:12345-0@lo:400: Request processed in 42us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239815.972674:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:2.0:1782239815.972699:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782239815.972727:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5dee25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1868813758914560:0@lo:400: 00000100:00100000:2.0:1782239815.972735:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5dee24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1868813758914176:0@lo:400: 00000100:00100000:1.0:1782239815.975992:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5dee24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1868813758914304:0@lo:400: 00000100:00100000:1.0:1782239815.976069:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239815.976125:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782239815.976132:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5dee26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1868813758914432:0@lo:400: 00000100:00100000:1.0:1782239815.976157:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239815.976193:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758914688 00000100:00100000:1.0:1782239815.976199:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758914688 00000100:00100000:1.0:1782239815.976247:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758914432 00000100:00100000:1.0:1782239815.976250:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758914432 00000100:00100000:1.0:1782239815.976266:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1782239815.976287:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fbf25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1868813758914688:12345-0@lo:400: 00000100:00100000:1.0:1782239815.976341:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fbf25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1868813758914688:12345-0@lo:400: Request processed in 56us (4103us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239815.976349:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1782239815.976364:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1782239815.976370:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb6018cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1868813758914432:12345-0@lo:400: 00000100:00100000:1.0:1782239815.976401:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb6018cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1868813758914432:12345-0@lo:400: Request processed in 31us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239815.976407:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1782239815.976459:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782239815.976490:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5dee26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3306:1868813758914048:0@lo:400: 00010000:00080000:1.0:1782239815.976529:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb5dee26300 x1868813758914432/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782239831 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782239815.976542:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5dee26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1868813758914432:0@lo:400: 00000100:00100000:1.0:1782239815.976570:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758914304 00000100:00100000:1.0:1782239815.976574:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758914304 00000100:00100000:1.0:1782239815.976616:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1782239815.976626:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb6018cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1868813758914304:12345-0@lo:400: 00000100:00100000:1.0:1782239815.976665:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb6018cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1868813758914304:12345-0@lo:400: Request processed in 41us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239815.976672:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:1.0:1782239815.976684:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1782239815.976705:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb5f48c0e00 x1868813758914688/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782239831 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782239815.976715:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f48c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1868813758914688:0@lo:400: 00000100:00100000:1.0:1782239815.976744:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5dee24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1868813758914304:0@lo:400: 00000100:00100000:1.0:1782239816.479021:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb60135bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1868813758914816:0@lo:13: 00000100:00100000:1.0:1782239816.479136:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239816.479338:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758914816 00000100:00100000:2.0:1782239816.479349:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758914816 00000100:00100000:2.0:1782239816.479700:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1782239816.479713:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb6018cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1868813758914816:12345-0@lo:13: 00002000:00000024:2.0:1782239816.479773:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782239816.485102:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb6018cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1868813758914816:12345-0@lo:13: Request processed in 5066us (5640us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239816.485124:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1782239816.485818:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb60135bb80 x1868813758914816/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782239832 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782239816.485857:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb60135bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1868813758914816:0@lo:13: 00000001:00100000:0.0:1782239816.563977:0:7493:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 36dd742b-25b8-431e-bf41-75f2fff47ffb 00010000:00010000:0.0:1782239816.927114:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1782239817.045516:0:5812:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 36dd742b-25b8-431e-bf41-75f2fff47ffb 00000100:00100000:0.0:1782239817.754585:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239817.754636:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239817.754692:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239817.754737:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239817.754822:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737922176 00000100:00100000:0.0:1782239817.754834:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737922176 00000100:00100000:0.0:1782239817.754906:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 23 00000100:00100000:0.0:1782239817.754920:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8ec9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+6:2345:x1868813737922176:12345-192.168.203.32@tcp:400: 00000100:00100000:0.0:1782239817.755018:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8ec9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+6:2345:x1868813737922176:12345-192.168.203.32@tcp:400: Request processed in 102us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239817.755027:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 23 00000100:00100000:0.0:1782239817.755055:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737922304 00000100:00100000:0.0:1782239817.755059:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737922304 00000100:00100000:0.0:1782239817.755096:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737922432 00000100:00100000:0.0:1782239817.755099:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737922432 00000100:00100000:0.0:1782239817.755115:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 7 00000100:00100000:0.0:1782239817.755121:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+5:2345:x1868813737922304:12345-192.168.203.32@tcp:400: 00000100:00100000:0.0:1782239817.755149:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+5:2345:x1868813737922304:12345-192.168.203.32@tcp:400: Request processed in 28us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239817.755156:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 7 00000100:00100000:0.0:1782239817.755168:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 8 00000100:00100000:0.0:1782239817.755174:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8ec9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+5:2345:x1868813737922432:12345-192.168.203.32@tcp:400: 00000100:00100000:0.0:1782239817.755209:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8ec9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+5:2345:x1868813737922432:12345-192.168.203.32@tcp:400: Request processed in 35us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239817.755216:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 8 00000100:00100000:3.0:1782239817.755712:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737922048 00000100:00100000:3.0:1782239817.755720:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737922048 00000100:00100000:3.0:1782239817.755810:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 128 00000100:00100000:3.0:1782239817.755819:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5c886b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afaefb1a-536b-42a3-a3ff-47200f8611c3+10:2345:x1868813737922048:12345-192.168.203.32@tcp:400: 00000100:00100000:3.0:1782239817.755876:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5c886b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afaefb1a-536b-42a3-a3ff-47200f8611c3+10:2345:x1868813737922048:12345-192.168.203.32@tcp:400: Request processed in 59us (1306us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239817.755884:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 128 00000100:00080000:1.0:1782239817.758536:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782239817.758551:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782239817.758569:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1782239817.951233:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782239818.298661:0:8145:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1782239818.974990:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782239820.001653:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782239820.069474:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fbf27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813758914944:0@lo:13: 00000100:00100000:0.0:1782239820.069695:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239820.073652:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758914944 00000100:00100000:1.0:1782239820.073667:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758914944 00000100:00100000:0.0:1782239820.080339:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1782239820.080354:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8ecb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1868813758914944:12345-0@lo:13: 00002000:00000024:0.0:1782239820.080393:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782239820.080466:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8ecb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1868813758914944:12345-0@lo:13: Request processed in 115us (10771us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239820.080473:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1782239820.080597:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb5fbf27b80 x1868813758914944/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782239836 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782239820.080617:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fbf27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813758914944:0@lo:13: 00000100:00080000:3.0:1782239820.080831:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1782239821.024258:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782239821.087432:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5e8ecaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3306:1868813758915072:0@lo:400: 00000100:00100000:2.0:1782239821.087434:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5e8ec8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1868813758915200:0@lo:400: 00000100:00100000:0.0:1782239821.087467:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5e8ec8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1868813758915328:0@lo:400: 00000100:00100000:3.0:1782239821.090402:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5e8ec8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813758915456:0@lo:400: 00000100:00100000:0.0:1782239821.092165:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239821.092295:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758915328 00000100:00100000:0.0:1782239821.092307:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758915328 00000100:00100000:0.0:1782239821.092396:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1782239821.092411:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8ec8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1868813758915328:12345-0@lo:400: 00000100:00100000:0.0:1782239821.092495:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8ec8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1868813758915328:12345-0@lo:400: Request processed in 89us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239821.092503:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:0.0:1782239821.092531:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782239821.092571:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5e8ec8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1868813758915328:0@lo:400: 00000100:00100000:1.0:1782239821.093352:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239821.093501:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758915072 00000100:00100000:0.0:1782239821.093510:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758915072 00000100:00100000:0.0:1782239821.093573:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1782239821.093583:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5c886a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:3306:x1868813758915072:12345-0@lo:400: 00000100:00100000:0.0:1782239821.093703:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5c886a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:3306:x1868813758915072:12345-0@lo:400: Request processed in 121us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239821.093712:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1782239821.093789:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5e8ecaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3306:1868813758915072:0@lo:400: 00000100:00100000:0.0:1782239821.093817:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5e8eca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1868813758915584:0@lo:400: 00000100:00100000:0.0:1782239821.093851:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239821.093877:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758915584 00000100:00100000:0.0:1782239821.093880:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758915584 00000100:00100000:0.0:1782239821.093914:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1782239821.093920:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8ecaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1868813758915584:12345-0@lo:400: 00000100:00100000:0.0:1782239821.093951:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8ecaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1868813758915584:12345-0@lo:400: Request processed in 31us (99us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239821.093957:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:0.0:1782239821.093973:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782239821.094147:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5e8eca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1868813758915584:0@lo:400: 00000100:00100000:0.0:1782239821.094161:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782239821.094168:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5e8ec9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813758915712:0@lo:400: 00000100:00100000:0.0:1782239821.094195:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239821.094548:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758915712 00000100:00100000:1.0:1782239821.094553:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758915712 00000100:00100000:0.0:1782239821.094851:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1782239821.094858:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8eca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1868813758915712:12345-0@lo:400: 00000100:00100000:0.0:1782239821.094902:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8eca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1868813758915712:12345-0@lo:400: Request processed in 45us (705us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239821.094920:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:0.0:1782239821.094936:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1782239821.094957:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb5e8ec9500 x1868813758915712/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782239837 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782239821.094968:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5e8ec9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813758915712:0@lo:400: 00000100:00100000:3.0:1782239821.098212:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239821.098571:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239821.098638:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758915200 00000100:00100000:1.0:1782239821.098650:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758915200 00000100:00100000:1.0:1782239821.098716:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1782239821.098725:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fbf27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1868813758915200:12345-0@lo:400: 00000100:00100000:1.0:1782239821.098850:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fbf27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1868813758915200:12345-0@lo:400: Request processed in 124us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239821.098860:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1782239821.098923:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5e8ec8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1868813758915200:0@lo:400: 00000100:00100000:0.0:1782239821.099350:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758915456 00000100:00100000:0.0:1782239821.099357:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758915456 00000100:00100000:0.0:1782239821.099398:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1782239821.099406:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb601359180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1868813758915456:12345-0@lo:400: 00000100:00100000:0.0:1782239821.099464:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb601359180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1868813758915456:12345-0@lo:400: Request processed in 58us (1264us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239821.099472:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1782239821.099536:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb5e8ec8700 x1868813758915456/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782239837 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782239821.099551:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5e8ec8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813758915456:0@lo:400: 00000100:00100000:3.0:1782239821.605975:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782239821.605998:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb601359c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813758915840:0@lo:13: 00000100:00100000:3.0:1782239821.606074:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239821.606136:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758915840 00000100:00100000:3.0:1782239821.606143:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758915840 00000100:00100000:3.0:1782239821.606183:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1782239821.606192:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb60135bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1868813758915840:12345-0@lo:13: 00002000:00000024:3.0:1782239821.606225:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782239821.606269:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb60135bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1868813758915840:12345-0@lo:13: Request processed in 78us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239821.606276:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1782239821.606312:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb601359c00 x1868813758915840/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782239837 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782239821.606329:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb601359c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813758915840:0@lo:13: 00010000:00010000:0.0:1782239822.046962:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782239822.086685:0:8294:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe7e7dd620 20000000:00000080:3.0:1782239822.086702:0:8294:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9bb5f7c8d800 uarg=0000000000000000 20000000:01000000:3.0:1782239822.086735:0:8294:0:(mgs_llog.c:2004:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1782239822.086737:0:8294:0:(mgs_llog.c:6054:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1782239822.086745:0:8294:0:(mgs_llog.c:6085:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:3.0:1782239822.086773:0:8294:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:3.0:1782239822.086778:0:8294:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:3.0:1782239822.086794:0:8294:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1782239822.086796:0:8294:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1782239822.086981:0:8294:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1782239822.086984:0:8294:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1782239822.089349:0:8295:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:2.0:1782239822.090676:0:8294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:2.0:1782239822.090734:0:8294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:2.0:1782239822.091080:0:8294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:2.0:1782239822.091097:0:8294:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1782239822.091100:0:8294:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1782239822.092202:0:8296:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:2.0:1782239822.093155:0:8294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:2.0:1782239822.093211:0:8294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:2.0:1782239822.093258:0:8294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:2.0:1782239822.093272:0:8294:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1782239822.093274:0:8294:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1782239822.094302:0:8297:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:2.0:1782239822.095007:0:8294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:2.0:1782239822.095084:0:8294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:2.0:1782239822.095132:0:8294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:2.0:1782239822.095146:0:8294:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1782239822.095149:0:8294:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1782239822.096350:0:8298:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:2.0:1782239822.097503:0:8294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:2.0:1782239822.097571:0:8294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:2.0:1782239822.097603:0:8294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:2.0:1782239822.097621:0:8294:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1782239822.097640:0:8294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bb602044600/0x8c5345f1c1ec4c7f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239822.097656:0:8294:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bb5c0031a00/0x8c5345f1c1ec4b7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4b75 expref: 18 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239822.097663:0:8294:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bb5c2a44c00/0x8c5345f1c1ec4ba6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4b9f expref: 18 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239822.097669:0:8294:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bb5c0030400/0x8c5345f1c1ec4bd0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4bc9 expref: 18 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239822.097674:0:8294:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bb5c1677000/0x8c5345f1c1ec4bde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4bd7 expref: 18 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239822.097680:0:8294:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bb602044200/0x8c5345f1c1ec4bec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4be5 expref: 18 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239822.097686:0:8294:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bb5c0031400/0x8c5345f1c1ec4c08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4c01 expref: 18 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239822.097691:0:8294:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bb5c2a44a00/0x8c5345f1c1ec4c32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4c2b expref: 18 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239822.097699:0:8294:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bb602045e00/0x8c5345f1c1ec4c40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e373 expref: 9 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239822.097713:0:8294:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bb5c0031800/0x8c5345f1c1ec4c47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e37a expref: 9 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239822.097720:0:8294:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bb602044600/0x8c5345f1c1ec4c7f lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239822.098529:0:8294:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bb5c0031800/0x8c5345f1c1ec4c47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e37a expref: 9 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239822.098547:0:8294:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bb5c0031800/0x8c5345f1c1ec4c47 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e37a expref: 9 pid: 5784 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239822.098561:0:8294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fbf26680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8294:1868813758915968:192.168.203.32@tcp:104: 00010000:00010000:2.0:1782239822.098702:0:8294:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bb602045e00/0x8c5345f1c1ec4c40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e373 expref: 9 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239822.098711:0:8294:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bb602045e00/0x8c5345f1c1ec4c40 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e373 expref: 9 pid: 5783 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239822.098720:0:8294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fbf25c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8294:1868813758916096:192.168.203.32@tcp:104: 00010000:00010000:2.0:1782239822.098777:0:8294:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bb5c2a44a00/0x8c5345f1c1ec4c32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8c5345f1c1ec4c2b expref: 18 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239822.098785:0:8294:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bb5c2a44a00/0x8c5345f1c1ec4c32 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8c5345f1c1ec4c2b expref: 18 pid: 5783 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239822.098804:0:8294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fbf27800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8294:1868813758916224:0@lo:104: 00000100:00100000:2.0:1782239822.098846:0:8294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782239822.098906:0:8294:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bb5c0031400/0x8c5345f1c1ec4c08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8c5345f1c1ec4c01 expref: 18 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239822.098914:0:8294:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bb5c0031400/0x8c5345f1c1ec4c08 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8c5345f1c1ec4c01 expref: 18 pid: 5783 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239822.098922:0:8294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fbf27b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8294:1868813758916352:0@lo:104: 00000100:00100000:2.0:1782239822.098946:0:8294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782239822.098979:0:8294:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bb602044200/0x8c5345f1c1ec4bec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8c5345f1c1ec4be5 expref: 18 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239822.098986:0:8294:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bb602044200/0x8c5345f1c1ec4bec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8c5345f1c1ec4be5 expref: 18 pid: 5785 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239822.098994:0:8294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fbf25180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8294:1868813758916480:0@lo:104: 00010000:00010000:2.0:1782239822.099018:0:8294:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bb5c1677000/0x8c5345f1c1ec4bde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8c5345f1c1ec4bd7 expref: 18 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239822.099025:0:8294:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bb5c1677000/0x8c5345f1c1ec4bde lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8c5345f1c1ec4bd7 expref: 18 pid: 5784 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239822.099032:0:8294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5dee24a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8294:1868813758916608:0@lo:104: 00010000:00010000:2.0:1782239822.099063:0:8294:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bb5c0030400/0x8c5345f1c1ec4bd0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8c5345f1c1ec4bc9 expref: 18 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239822.099071:0:8294:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bb5c0030400/0x8c5345f1c1ec4bd0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8c5345f1c1ec4bc9 expref: 18 pid: 5783 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239822.099079:0:8294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5dee26300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8294:1868813758916736:0@lo:104: 00010000:00010000:2.0:1782239822.099100:0:8294:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bb5c2a44c00/0x8c5345f1c1ec4ba6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8c5345f1c1ec4b9f expref: 18 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239822.099115:0:8294:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bb5c2a44c00/0x8c5345f1c1ec4ba6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8c5345f1c1ec4b9f expref: 18 pid: 5785 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239822.099124:0:8294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5dee26d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8294:1868813758916864:0@lo:104: 00010000:00010000:2.0:1782239822.099149:0:8294:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bb5c0031a00/0x8c5345f1c1ec4b7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8c5345f1c1ec4b75 expref: 18 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239822.099156:0:8294:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bb5c0031a00/0x8c5345f1c1ec4b7c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8c5345f1c1ec4b75 expref: 18 pid: 5784 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239822.099164:0:8294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5dee24700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8294:1868813758916992:0@lo:104: 00000100:00100000:2.0:1782239822.099182:0:8294:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c7e7c780 going to sleep for 11 seconds 00000100:00100000:3.0:1782239822.099552:0:5773:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1782239822.099571:0:5773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239822.099597:0:5773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239822.099606:0:5773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239822.099614:0:5773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239822.099621:0:5773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239822.099630:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758916224 00000100:00100000:3.0:1782239822.099636:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758916224 00000100:00100000:3.0:1782239822.099673:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758916352 00000100:00100000:3.0:1782239822.099675:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758916352 00000100:00100000:3.0:1782239822.099686:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758916480 00000100:00100000:3.0:1782239822.099689:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758916480 00000100:00100000:3.0:1782239822.099698:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758916608 00000100:00100000:3.0:1782239822.099700:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758916608 00000100:00100000:3.0:1782239822.099709:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758916736 00000100:00100000:3.0:1782239822.099711:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758916736 00000100:00100000:3.0:1782239822.099719:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758916864 00000100:00100000:3.0:1782239822.099721:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758916864 00000100:00100000:3.0:1782239822.099730:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758916992 00000100:00100000:3.0:1782239822.099732:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758916992 00000100:00100000:3.0:1782239822.099776:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1782239822.099787:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fbf24000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+9:8294:x1868813758916224:12345-0@lo:104: 00010000:00010000:3.0:1782239822.099800:0:5773:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a45400/0x8c5345f1c1ec4c2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c5345f1c1ec4c32 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239822.099851:0:5773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782239822.099862:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fbf24000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+9:8294:x1868813758916224:12345-0@lo:104: Request processed in 78us (1016us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239822.099870:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1782239822.099887:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1782239822.099893:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ee2e8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+8:8294:x1868813758916352:12345-0@lo:104: 00010000:00010000:3.0:1782239822.099900:0:5773:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.132@tcp lock: ffff9bb5c1676000/0x8c5345f1c1ec4c01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c5345f1c1ec4c08 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239822.099933:0:5773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1782239822.099938:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ee2e8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+8:8294:x1868813758916352:12345-0@lo:104: Request processed in 46us (992us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239822.099943:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1782239822.099972:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1782239822.099978:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb601359c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+7:8294:x1868813758916480:12345-0@lo:104: 00010000:00010000:3.0:1782239822.099985:0:5773:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.132@tcp lock: ffff9bb5c0031e00/0x8c5345f1c1ec4be5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c5345f1c1ec4bec expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239822.100009:0:5773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1782239822.100014:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb601359c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+7:8294:x1868813758916480:12345-0@lo:104: Request processed in 38us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239822.100019:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1782239822.100031:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1782239822.100037:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f780c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+6:8294:x1868813758916608:12345-0@lo:104: 00010000:00010000:3.0:1782239822.100044:0:5773:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.132@tcp lock: ffff9bb5c1676a00/0x8c5345f1c1ec4bd7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c5345f1c1ec4bde expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239822.100083:0:5773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1782239822.100094:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f780c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+6:8294:x1868813758916608:12345-0@lo:104: Request processed in 58us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239822.100099:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1782239822.100112:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1782239822.100118:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f780ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+5:8294:x1868813758916736:12345-0@lo:104: 00010000:00010000:3.0:1782239822.100130:0:5773:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.132@tcp lock: ffff9bb5c1677200/0x8c5345f1c1ec4bc9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c5345f1c1ec4bd0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239822.100156:0:5773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1782239822.100161:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f780ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+5:8294:x1868813758916736:12345-0@lo:104: Request processed in 43us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239822.100166:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1782239822.100177:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1782239822.100183:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f780c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+4:8294:x1868813758916864:12345-0@lo:104: 00010000:00010000:3.0:1782239822.100190:0:5773:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.132@tcp lock: ffff9bb5c0030e00/0x8c5345f1c1ec4b9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c5345f1c1ec4ba6 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239822.100213:0:5773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:3.0:1782239822.100217:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f780c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+4:8294:x1868813758916864:12345-0@lo:104: Request processed in 35us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239822.100222:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1782239822.100233:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1782239822.100238:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f780e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+3:8294:x1868813758916992:12345-0@lo:104: 00010000:00010000:3.0:1782239822.100245:0:5773:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.132@tcp lock: ffff9bb5c1677400/0x8c5345f1c1ec4b75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c5345f1c1ec4b7c expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239822.100268:0:5773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:3.0:1782239822.100278:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f780e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+3:8294:x1868813758916992:12345-0@lo:104: Request processed in 40us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239822.100283:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:3.0:1782239822.100303:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1782239822.100308:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a45400/0x8c5345f1c1ec4c2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c5345f1c1ec4c32 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239822.100315:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5c2a45400 already unused, calling callback (ffffffffc1d0cc20) 10000000:00010000:3.0:1782239822.100320:0:5779:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a45400/0x8c5345f1c1ec4c2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x8c5345f1c1ec4c32 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239822.100328:0:5779:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a45400/0x8c5345f1c1ec4c2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x8c5345f1c1ec4c32 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782239822.100336:0:5779:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a45400/0x8c5345f1c1ec4c2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x8c5345f1c1ec4c32 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782239822.100342:0:5779:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782239822.100370:0:5779:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a45400/0x8c5345f1c1ec4c2b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c5345f1c1ec4c32 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239822.100377:0:5779:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782239822.100393:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a45400/0x8c5345f1c1ec4c2b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c5345f1c1ec4c32 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239822.100399:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a45400/0x8c5345f1c1ec4c2b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c5345f1c1ec4c32 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239822.100411:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1782239822.100414:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.132@tcp lock: ffff9bb5c1676000/0x8c5345f1c1ec4c01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c5345f1c1ec4c08 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239822.100430:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5c1676000 already unused, calling callback (ffffffffc1d0cc20) 10000000:00010000:3.0:1782239822.100433:0:5779:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.132@tcp lock: ffff9bb5c1676000/0x8c5345f1c1ec4c01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x8c5345f1c1ec4c08 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239822.100440:0:5779:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.132@tcp lock: ffff9bb5c1676000/0x8c5345f1c1ec4c01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x8c5345f1c1ec4c08 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782239822.100445:0:5779:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.132@tcp lock: ffff9bb5c1676000/0x8c5345f1c1ec4c01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x8c5345f1c1ec4c08 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782239822.100449:0:5779:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782239822.100462:0:5779:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.132@tcp lock: ffff9bb5c1676000/0x8c5345f1c1ec4c01 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c5345f1c1ec4c08 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239822.100467:0:5779:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782239822.100482:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.132@tcp lock: ffff9bb5c1676000/0x8c5345f1c1ec4c01 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c5345f1c1ec4c08 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239822.100487:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.132@tcp lock: ffff9bb5c1676000/0x8c5345f1c1ec4c01 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c5345f1c1ec4c08 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239822.100497:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1782239822.100499:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.132@tcp lock: ffff9bb5c0031e00/0x8c5345f1c1ec4be5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c5345f1c1ec4bec expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239822.100504:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5c0031e00 already unused, calling callback (ffffffffc1d0cc20) 10000000:00010000:3.0:1782239822.100506:0:5779:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.132@tcp lock: ffff9bb5c0031e00/0x8c5345f1c1ec4be5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x8c5345f1c1ec4bec expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239822.100524:0:5779:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.132@tcp lock: ffff9bb5c0031e00/0x8c5345f1c1ec4be5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x8c5345f1c1ec4bec expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782239822.100529:0:5779:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.132@tcp lock: ffff9bb5c0031e00/0x8c5345f1c1ec4be5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x8c5345f1c1ec4bec expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782239822.100534:0:5779:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782239822.100546:0:5779:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.132@tcp lock: ffff9bb5c0031e00/0x8c5345f1c1ec4be5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c5345f1c1ec4bec expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239822.100551:0:5779:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782239822.100555:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.132@tcp lock: ffff9bb5c0031e00/0x8c5345f1c1ec4be5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c5345f1c1ec4bec expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239822.100561:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.132@tcp lock: ffff9bb5c0031e00/0x8c5345f1c1ec4be5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c5345f1c1ec4bec expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239822.100569:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1782239822.100572:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.132@tcp lock: ffff9bb5c1676a00/0x8c5345f1c1ec4bd7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c5345f1c1ec4bde expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239822.100576:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5c1676a00 already unused, calling callback (ffffffffc1d0cc20) 10000000:00010000:3.0:1782239822.100579:0:5779:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.132@tcp lock: ffff9bb5c1676a00/0x8c5345f1c1ec4bd7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x8c5345f1c1ec4bde expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239822.100585:0:5779:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.132@tcp lock: ffff9bb5c1676a00/0x8c5345f1c1ec4bd7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x8c5345f1c1ec4bde expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782239822.100591:0:5779:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.132@tcp lock: ffff9bb5c1676a00/0x8c5345f1c1ec4bd7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x8c5345f1c1ec4bde expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782239822.100600:0:5779:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782239822.100613:0:5779:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.132@tcp lock: ffff9bb5c1676a00/0x8c5345f1c1ec4bd7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c5345f1c1ec4bde expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239822.100619:0:5779:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782239822.100624:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.132@tcp lock: ffff9bb5c1676a00/0x8c5345f1c1ec4bd7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c5345f1c1ec4bde expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239822.100630:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.132@tcp lock: ffff9bb5c1676a00/0x8c5345f1c1ec4bd7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c5345f1c1ec4bde expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239822.100639:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1782239822.100642:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.132@tcp lock: ffff9bb5c1677200/0x8c5345f1c1ec4bc9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c5345f1c1ec4bd0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239822.100647:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5c1677200 already unused, calling callback (ffffffffc1d0cc20) 10000000:00010000:3.0:1782239822.100650:0:5779:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.132@tcp lock: ffff9bb5c1677200/0x8c5345f1c1ec4bc9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8c5345f1c1ec4bd0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239822.100658:0:5779:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.132@tcp lock: ffff9bb5c1677200/0x8c5345f1c1ec4bc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8c5345f1c1ec4bd0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782239822.100663:0:5779:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.132@tcp lock: ffff9bb5c1677200/0x8c5345f1c1ec4bc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8c5345f1c1ec4bd0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782239822.100667:0:5779:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782239822.100677:0:5779:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.132@tcp lock: ffff9bb5c1677200/0x8c5345f1c1ec4bc9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c5345f1c1ec4bd0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239822.100682:0:5779:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782239822.100691:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.132@tcp lock: ffff9bb5c1677200/0x8c5345f1c1ec4bc9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c5345f1c1ec4bd0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239822.100698:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.132@tcp lock: ffff9bb5c1677200/0x8c5345f1c1ec4bc9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c5345f1c1ec4bd0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239822.100707:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782239822.100710:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.132@tcp lock: ffff9bb5c0030e00/0x8c5345f1c1ec4b9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c5345f1c1ec4ba6 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239822.100715:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5c0030e00 already unused, calling callback (ffffffffc1d0cc20) 10000000:00010000:3.0:1782239822.100717:0:5779:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.132@tcp lock: ffff9bb5c0030e00/0x8c5345f1c1ec4b9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8c5345f1c1ec4ba6 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239822.100724:0:5779:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.132@tcp lock: ffff9bb5c0030e00/0x8c5345f1c1ec4b9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8c5345f1c1ec4ba6 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782239822.100729:0:5779:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.132@tcp lock: ffff9bb5c0030e00/0x8c5345f1c1ec4b9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8c5345f1c1ec4ba6 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782239822.100733:0:5779:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782239822.100769:0:5779:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.132@tcp lock: ffff9bb5c0030e00/0x8c5345f1c1ec4b9f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c5345f1c1ec4ba6 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239822.100775:0:5779:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782239822.100779:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.132@tcp lock: ffff9bb5c0030e00/0x8c5345f1c1ec4b9f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c5345f1c1ec4ba6 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239822.100784:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.132@tcp lock: ffff9bb5c0030e00/0x8c5345f1c1ec4b9f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c5345f1c1ec4ba6 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239822.100792:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782239822.100801:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.132@tcp lock: ffff9bb5c1677400/0x8c5345f1c1ec4b75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c5345f1c1ec4b7c expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239822.100806:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5c1677400 already unused, calling callback (ffffffffc1d0cc20) 10000000:00010000:3.0:1782239822.100808:0:5779:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.132@tcp lock: ffff9bb5c1677400/0x8c5345f1c1ec4b75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8c5345f1c1ec4b7c expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239822.100814:0:5779:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.132@tcp lock: ffff9bb5c1677400/0x8c5345f1c1ec4b75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8c5345f1c1ec4b7c expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782239822.100820:0:5779:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.132@tcp lock: ffff9bb5c1677400/0x8c5345f1c1ec4b75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8c5345f1c1ec4b7c expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782239822.100825:0:5779:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782239822.100839:0:5779:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.132@tcp lock: ffff9bb5c1677400/0x8c5345f1c1ec4b75 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c5345f1c1ec4b7c expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239822.100845:0:5779:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782239822.100849:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.132@tcp lock: ffff9bb5c1677400/0x8c5345f1c1ec4b75 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c5345f1c1ec4b7c expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239822.100855:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.132@tcp lock: ffff9bb5c1677400/0x8c5345f1c1ec4b75 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c5345f1c1ec4b7c expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239822.100867:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782239822.100868:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782239822.100870:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782239822.100894:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f780d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3305:1868813758917120:0@lo:103: 00000100:00100000:3.0:1782239822.100932:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239822.100964:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f780e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3305:1868813758917632:0@lo:103: 00000100:00100000:3.0:1782239822.100994:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239822.101013:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782239822.101018:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f780f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3305:1868813758917504:0@lo:103: 00000100:00100000:3.0:1782239822.101036:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239822.101071:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f780ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3306:1868813758917248:0@lo:103: 00000100:00100000:3.0:1782239822.101105:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239822.101121:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f780dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3306:1868813758917760:0@lo:103: 00000100:00100000:3.0:1782239822.101138:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239822.101147:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1782239822.101152:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f780fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3306:1868813758917376:0@lo:103: 00000100:00100000:3.0:1782239822.101167:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239822.101176:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f780f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3306:1868813758917888:0@lo:103: 00000100:00100000:3.0:1782239822.101195:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239822.101217:0:7481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758917120 00000100:00100000:3.0:1782239822.101222:0:7481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758917120 00010000:00010000:3.0:1782239822.101245:0:7481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bb5c2a44a00/0x8c5345f1c1ec4c32 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c5345f1c1ec4c2b expref: 19 pid: 5783 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239822.101262:0:7481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758917632 00000100:00100000:3.0:1782239822.101264:0:7481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758917632 00010000:00010000:3.0:1782239822.101273:0:7481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bb5c0030400/0x8c5345f1c1ec4bd0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c5345f1c1ec4bc9 expref: 20 pid: 5783 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239822.101283:0:7481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758917504 00000100:00100000:3.0:1782239822.101286:0:7481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758917504 00010000:00010000:3.0:1782239822.101294:0:7481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bb5c1677000/0x8c5345f1c1ec4bde lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c5345f1c1ec4bd7 expref: 21 pid: 5784 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239822.101303:0:7481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758917248 00000100:00100000:3.0:1782239822.101310:0:7481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758917248 00010000:00010000:3.0:1782239822.101321:0:7481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bb5c0031400/0x8c5345f1c1ec4c08 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c5345f1c1ec4c01 expref: 22 pid: 5783 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239822.101331:0:7481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758917760 00000100:00100000:3.0:1782239822.101333:0:7481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758917760 00010000:00010000:3.0:1782239822.101341:0:7481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bb5c2a44c00/0x8c5345f1c1ec4ba6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c5345f1c1ec4b9f expref: 23 pid: 5785 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239822.101349:0:7481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758917376 00000100:00100000:3.0:1782239822.101351:0:7481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758917376 00010000:00010000:3.0:1782239822.101359:0:7481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bb602044200/0x8c5345f1c1ec4bec lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c5345f1c1ec4be5 expref: 24 pid: 5785 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239822.101368:0:7481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758917888 00000100:00100000:3.0:1782239822.101370:0:7481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758917888 00010000:00010000:3.0:1782239822.101379:0:7481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bb5c0031a00/0x8c5345f1c1ec4b7c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c5345f1c1ec4b75 expref: 25 pid: 5784 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239822.101390:0:7481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1782239822.101396:0:7481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f780c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+25:3305:x1868813758917120:12345-0@lo:103: 00010000:00010000:3.0:1782239822.101407:0:7481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782239822.101412:0:7481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bb5c2a44a00/0x8c5345f1c1ec4c32 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c5345f1c1ec4c2b expref: 25 pid: 5783 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239822.101421:0:7481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bb5c2a44a00/0x8c5345f1c1ec4c32 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8c5345f1c1ec4c2b expref: 25 pid: 5783 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239822.101437:0:7481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782239822.101467:0:7481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f780c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+25:3305:x1868813758917120:12345-0@lo:103: Request processed in 71us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239822.101474:0:7481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1782239822.101493:0:7481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1782239822.101498:0:7481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f780d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+24:3305:x1868813758917632:12345-0@lo:103: 00010000:00010000:3.0:1782239822.101506:0:7481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782239822.101510:0:7481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bb5c0030400/0x8c5345f1c1ec4bd0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c5345f1c1ec4bc9 expref: 24 pid: 5783 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239822.101519:0:7481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bb5c0030400/0x8c5345f1c1ec4bd0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8c5345f1c1ec4bc9 expref: 24 pid: 5783 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239822.101527:0:7481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782239822.101548:0:7481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f780d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+24:3305:x1868813758917632:12345-0@lo:103: Request processed in 50us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239822.101554:0:7481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1782239822.101565:0:7481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1782239822.101571:0:7481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f780ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+23:3305:x1868813758917504:12345-0@lo:103: 00010000:00010000:3.0:1782239822.101577:0:7481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782239822.101581:0:7481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bb5c1677000/0x8c5345f1c1ec4bde lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c5345f1c1ec4bd7 expref: 23 pid: 5784 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239822.101589:0:7481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bb5c1677000/0x8c5345f1c1ec4bde lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8c5345f1c1ec4bd7 expref: 23 pid: 5784 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239822.101598:0:7481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782239822.101615:0:7481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f780ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+23:3305:x1868813758917504:12345-0@lo:103: Request processed in 45us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239822.101621:0:7481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1782239822.101631:0:7481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1782239822.101637:0:7481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f780df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+22:3306:x1868813758917248:12345-0@lo:103: 00010000:00010000:3.0:1782239822.101644:0:7481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782239822.101653:0:7481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bb5c0031400/0x8c5345f1c1ec4c08 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c5345f1c1ec4c01 expref: 22 pid: 5783 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239822.101661:0:7481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bb5c0031400/0x8c5345f1c1ec4c08 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8c5345f1c1ec4c01 expref: 22 pid: 5783 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239822.101670:0:7481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782239822.101694:0:7481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f780df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+22:3306:x1868813758917248:12345-0@lo:103: Request processed in 56us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239822.101699:0:7481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1782239822.101710:0:7481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1782239822.101716:0:7481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f780d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+21:3306:x1868813758917760:12345-0@lo:103: 00010000:00010000:3.0:1782239822.101723:0:7481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782239822.101727:0:7481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bb5c2a44c00/0x8c5345f1c1ec4ba6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c5345f1c1ec4b9f expref: 21 pid: 5785 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239822.101735:0:7481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bb5c2a44c00/0x8c5345f1c1ec4ba6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8c5345f1c1ec4b9f expref: 21 pid: 5785 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239822.101743:0:7481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782239822.101786:0:7481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f780d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+21:3306:x1868813758917760:12345-0@lo:103: Request processed in 70us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239822.101792:0:7481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1782239822.101802:0:7481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1782239822.101807:0:7481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f780f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+20:3306:x1868813758917376:12345-0@lo:103: 00010000:00010000:3.0:1782239822.101815:0:7481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782239822.101820:0:7481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bb602044200/0x8c5345f1c1ec4bec lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c5345f1c1ec4be5 expref: 20 pid: 5785 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239822.101837:0:7481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bb602044200/0x8c5345f1c1ec4bec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8c5345f1c1ec4be5 expref: 20 pid: 5785 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239822.101846:0:7481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782239822.101865:0:7481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f780f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+20:3306:x1868813758917376:12345-0@lo:103: Request processed in 58us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239822.101870:0:7481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1782239822.101881:0:7481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1782239822.101886:0:7481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d810f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:3306:x1868813758917888:12345-0@lo:103: 00010000:00010000:3.0:1782239822.101893:0:7481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782239822.101897:0:7481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bb5c0031a00/0x8c5345f1c1ec4b7c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c5345f1c1ec4b75 expref: 19 pid: 5784 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239822.101904:0:7481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bb5c0031a00/0x8c5345f1c1ec4b7c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8c5345f1c1ec4b75 expref: 19 pid: 5784 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239822.101913:0:7481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782239822.101932:0:7481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d810f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:3306:x1868813758917888:12345-0@lo:103: Request processed in 46us (735us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239822.101937:0:7481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:3.0:1782239822.101982:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782239822.102005:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f780fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3306:1868813758917376:0@lo:103: 00000100:00100000:3.0:1782239822.102014:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f780f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3306:1868813758917888:0@lo:103: 00000100:00100000:3.0:1782239822.102020:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f780ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3306:1868813758917248:0@lo:103: 00000100:00100000:3.0:1782239822.102026:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f780dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3306:1868813758917760:0@lo:103: 00000100:00100000:3.0:1782239822.102068:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f780f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3305:1868813758917504:0@lo:103: 00000100:00100000:3.0:1782239822.102086:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f780d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3305:1868813758917120:0@lo:103: 00000100:00100000:3.0:1782239822.102094:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f780e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3305:1868813758917632:0@lo:103: 00010000:00010000:2.0:1782239822.102468:0:8294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb5c2a44a00/0x8c5345f1c1ec4c32 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8c5345f1c1ec4c2b expref: 18 pid: 5783 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239822.102482:0:8294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fbf27800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8294:1868813758916224:0@lo:104: 00010000:00010000:2.0:1782239822.102491:0:8294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb5c0031400/0x8c5345f1c1ec4c08 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8c5345f1c1ec4c01 expref: 17 pid: 5783 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239822.102499:0:8294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fbf27b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8294:1868813758916352:0@lo:104: 00010000:00010000:2.0:1782239822.102507:0:8294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb602044200/0x8c5345f1c1ec4bec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8c5345f1c1ec4be5 expref: 16 pid: 5785 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239822.102516:0:8294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fbf25180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8294:1868813758916480:0@lo:104: 00010000:00010000:2.0:1782239822.102524:0:8294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb5c1677000/0x8c5345f1c1ec4bde lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8c5345f1c1ec4bd7 expref: 15 pid: 5784 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239822.102533:0:8294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5dee24a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8294:1868813758916608:0@lo:104: 00010000:00010000:2.0:1782239822.102555:0:8294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb5c0030400/0x8c5345f1c1ec4bd0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8c5345f1c1ec4bc9 expref: 14 pid: 5783 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239822.102564:0:8294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5dee26300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8294:1868813758916736:0@lo:104: 00010000:00010000:2.0:1782239822.102572:0:8294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb5c2a44c00/0x8c5345f1c1ec4ba6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8c5345f1c1ec4b9f expref: 13 pid: 5785 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239822.102580:0:8294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5dee26d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8294:1868813758916864:0@lo:104: 00010000:00010000:2.0:1782239822.102588:0:8294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb5c0031a00/0x8c5345f1c1ec4b7c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8c5345f1c1ec4b75 expref: 12 pid: 5784 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239822.102596:0:8294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5dee24700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8294:1868813758916992:0@lo:104: 00000100:00100000:2.0:1782239822.107729:0:8294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fbf26680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8294:1868813758915968:192.168.203.32@tcp:104: 00000100:00100000:2.0:1782239822.107772:0:8294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fbf25c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8294:1868813758916096:192.168.203.32@tcp:104: 00010000:00010000:2.0:1782239822.107832:0:8294:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bb602044600/0x8c5345f1c1ec4c7f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239822.114526:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239822.114951:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239822.114987:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737922560 00000100:00100000:3.0:1782239822.114996:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737922560 00010000:00010000:3.0:1782239822.115113:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bb5c0031800/0x8c5345f1c1ec4c47 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e37a expref: 10 pid: 5784 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239822.115141:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737922688 00000100:00100000:3.0:1782239822.115144:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737922688 00010000:00010000:3.0:1782239822.115155:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bb602045e00/0x8c5345f1c1ec4c40 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e373 expref: 11 pid: 5783 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239822.115251:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 19 00000100:00100000:3.0:1782239822.115260:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f780e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:afaefb1a-536b-42a3-a3ff-47200f8611c3+11:2345:x1868813737922560:12345-192.168.203.32@tcp:103: 00010000:00010000:3.0:1782239822.115273:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782239822.115279:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bb5c0031800/0x8c5345f1c1ec4c47 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e37a expref: 11 pid: 5784 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239822.115292:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bb5c0031800/0x8c5345f1c1ec4c47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e37a expref: 11 pid: 5784 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239822.115309:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb5c0031800/0x8c5345f1c1ec4c47 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e37a expref: 11 pid: 5784 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239822.115381:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782239822.115501:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f780e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:afaefb1a-536b-42a3-a3ff-47200f8611c3+10:2345:x1868813737922560:12345-192.168.203.32@tcp:103: Request processed in 241us (983us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239822.115517:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 19 00000100:00100000:3.0:1782239822.115535:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 20 00000100:00100000:3.0:1782239822.115818:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f780d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:afaefb1a-536b-42a3-a3ff-47200f8611c3+9:2345:x1868813737922688:12345-192.168.203.32@tcp:103: 00010000:00010000:3.0:1782239822.115827:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782239822.115832:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bb602045e00/0x8c5345f1c1ec4c40 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e373 expref: 9 pid: 5783 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239822.115842:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bb602045e00/0x8c5345f1c1ec4c40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e373 expref: 9 pid: 5783 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239822.115853:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb602045e00/0x8c5345f1c1ec4c40 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e373 expref: 9 pid: 5783 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239822.115864:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bb602044600/0x8c5345f1c1ec4c7f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239822.115872:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb602044600/0x8c5345f1c1ec4c7f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239822.115887:0:5777:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bb602044600/0x8c5345f1c1ec4c7f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239822.115895:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bb602044600/0x8c5345f1c1ec4c7f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239822.115901:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bb602044600/0x8c5345f1c1ec4c7f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239822.115908:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bb602044600/0x8c5345f1c1ec4c7f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239822.115920:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb602044600 already unused, calling callback (ffffffffc1728ce0) 00010000:00010000:3.0:1782239822.115924:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bb602044600/0x8c5345f1c1ec4c7f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239822.115931:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bb602044600/0x8c5345f1c1ec4c7f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239822.115943:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bb602044600/0x8c5345f1c1ec4c7f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239822.115953:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782239822.115975:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f780d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:afaefb1a-536b-42a3-a3ff-47200f8611c3+8:2345:x1868813737922688:12345-192.168.203.32@tcp:103: Request processed in 161us (1024us total) trans 0 rc 0/0 00010000:00010000:2.0:1782239822.116630:0:8294:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bb602044600/0x8c5345f1c1ec4c7f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239822.116640:0:8294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bb602044600/0x8c5345f1c1ec4c7f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239822.116646:0:8294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb602044600/0x8c5345f1c1ec4c7f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239822.120808:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 20 00000100:00100000:0.0:1782239822.877969:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239822.878015:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239822.878057:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239822.878105:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239822.878213:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737922816 00000100:00100000:2.0:1782239822.878223:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737922816 00000100:00100000:1.0:1782239822.878268:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737923072 00000100:00100000:1.0:1782239822.878274:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737923072 00000100:00100000:2.0:1782239822.878286:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 130 00000100:00100000:2.0:1782239822.878310:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5c8869850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afaefb1a-536b-42a3-a3ff-47200f8611c3+8:2347:x1868813737922816:12345-192.168.203.32@tcp:400: 00000100:00100000:1.0:1782239822.878322:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737923200 00000100:00100000:1.0:1782239822.878327:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737923200 00000100:00100000:1.0:1782239822.878350:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 11 00000100:00100000:1.0:1782239822.878359:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8ec9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+5:2347:x1868813737923072:12345-192.168.203.32@tcp:400: 00000100:00100000:2.0:1782239822.878385:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5c8869850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afaefb1a-536b-42a3-a3ff-47200f8611c3+8:2347:x1868813737922816:12345-192.168.203.32@tcp:400: Request processed in 79us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239822.878393:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 130 00000100:00100000:2.0:1782239822.878435:0:6589:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1782239822.878443:0:6589:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1782239822.878473:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8ec9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+5:2347:x1868813737923072:12345-192.168.203.32@tcp:400: Request processed in 115us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239822.878482:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 11 00000100:00100000:2.0:1782239822.878576:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 12 00000100:00100000:1.0:1782239822.878583:0:6590:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1782239822.878588:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8ecbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+5:2347:x1868813737923200:12345-192.168.203.32@tcp:400: 00000100:00100000:2.0:1782239822.878639:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8ecbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+5:2347:x1868813737923200:12345-192.168.203.32@tcp:400: Request processed in 55us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239822.878656:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 12 00000100:00080000:2.0:1782239822.878676:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782239822.878681:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782239822.878775:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737922944 00000100:00100000:3.0:1782239822.878781:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737922944 00000100:00100000:3.0:1782239822.878822:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 27 00000100:00100000:3.0:1782239822.878832:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8ec8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+6:2347:x1868813737922944:12345-192.168.203.32@tcp:400: 00000100:00100000:3.0:1782239822.878865:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8ec8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+6:2347:x1868813737922944:12345-192.168.203.32@tcp:400: Request processed in 35us (807us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239822.878871:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 27 00000100:00080000:0.0:1782239822.879143:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1782239823.074805:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1782239823.582876:0:5787:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1782239823.582883:0:5787:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9bb5eddbf000 from 39 10000000:01000000:3.0:1782239823.582888:0:5787:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1782239823.582933:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a45400/0x8c5345f1c1ec4c86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239823.582961:0:5787:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a45400/0x8c5345f1c1ec4c86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239823.582973:0:5787:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a45400/0x8c5345f1c1ec4c86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239823.582997:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f780f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758918016:0@lo:101: 00000100:00100000:3.0:1782239823.583077:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239823.583149:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5d1cd03c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782239823.583277:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758918016 00000100:00100000:1.0:1782239823.583285:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758918016 00000100:00100000:1.0:1782239823.583343:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1782239823.583352:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5c886a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+12:5787:x1868813758918016:12345-0@lo:101: 00010000:00010000:1.0:1782239823.583365:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782239823.583381:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb5c1677400/0x8c5345f1c1ec4c8d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c5345f1c1ec4c86 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239823.583405:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb5c1677400/0x8c5345f1c1ec4c8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4c86 expref: 13 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239823.583414:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb5c1677400/0x8c5345f1c1ec4c8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4c86 expref: 13 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239823.583424:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5c1677400, rc 0) 00000100:00100000:1.0:1782239823.583474:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5c886a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+13:5787:x1868813758918016:12345-0@lo:101: Request processed in 123us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239823.583481:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1782239823.585229:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f780f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758918016:0@lo:101: 00010000:00010000:3.0:1782239823.585256:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a45400/0x8c5345f1c1ec4c86 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4c8d expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239823.585269:0:5787:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a45400/0x8c5345f1c1ec4c86 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c5345f1c1ec4c8d expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239823.585351:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f780f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758918144:0@lo:501: 00000100:00100000:3.0:1782239823.585405:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239823.585505:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5d1cd03c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782239823.591387:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758918144 00000100:00100000:0.0:1782239823.591403:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758918144 00000100:00100000:0.0:1782239823.591475:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1782239823.591485:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5c8868850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+13:5787:x1868813758918144:12345-0@lo:501: 00000100:00100000:0.0:1782239823.591828:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5c8868850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+13:5787:x1868813758918144:12345-0@lo:501: Request processed in 343us (6421us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239823.591835:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1782239823.592075:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f780f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758918144:0@lo:501: 00000100:00100000:3.0:1782239823.592123:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f780f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758918272:0@lo:503: 00000100:00100000:3.0:1782239823.592167:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239823.592205:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5d1cd03c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782239823.592329:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758918272 00000100:00100000:1.0:1782239823.592334:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758918272 00000100:00100000:1.0:1782239823.592367:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1782239823.592374:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5c886ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+13:5787:x1868813758918272:12345-0@lo:503: 00000100:00100000:1.0:1782239823.592536:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5c886ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+13:5787:x1868813758918272:12345-0@lo:503: Request processed in 162us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239823.592543:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1782239823.593062:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f780f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758918272:0@lo:503: 00000100:00100000:3.0:1782239823.593538:0:8313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f780f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:8313:1868813758918400:0@lo:502: 00000100:00100000:3.0:1782239823.593594:0:8313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239823.593629:0:8313:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5d1cd0300 going to sleep for 11 seconds 00000100:00100000:2.0:1782239823.593703:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758918400 00000100:00100000:2.0:1782239823.593709:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758918400 00000100:00100000:2.0:1782239823.593781:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1782239823.593790:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5c8869050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+13:8313:x1868813758918400:12345-0@lo:502: 00000100:00100000:2.0:1782239823.593994:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5c8869050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+13:8313:x1868813758918400:12345-0@lo:502: Request processed in 206us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239823.594232:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1782239823.594349:0:8313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f780f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:8313:1868813758918400:0@lo:502: 00000100:00100000:3.0:1782239823.594390:0:8313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f780f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:8313:1868813758918528:0@lo:502: 00000100:00100000:3.0:1782239823.594423:0:8313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239823.594452:0:8313:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5d1cd0300 going to sleep for 11 seconds 00000100:00100000:0.0:1782239823.596234:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758918528 00000100:00100000:0.0:1782239823.596262:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758918528 00000100:00100000:0.0:1782239823.596323:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1782239823.596332:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5c8869450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+13:8313:x1868813758918528:12345-0@lo:502: 00000100:00100000:0.0:1782239823.596590:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5c8869450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+13:8313:x1868813758918528:12345-0@lo:502: Request processed in 258us (2164us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239823.596598:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1782239823.596788:0:8313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f780f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:8313:1868813758918528:0@lo:502: 00000040:00080000:3.0:1782239823.596818:0:8313:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1782239823.597554:0:5787:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1782239823.597575:0:5787:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1782239823.597583:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a45400/0x8c5345f1c1ec4c86 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4c8d expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239823.597595:0:5787:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a45400/0x8c5345f1c1ec4c86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4c8d expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782239823.597605:0:5787:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1782239823.597607:0:5787:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1782239823.597610:0:5787:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1782239823.597642:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5c0031a00/0x8c5345f1c1ec4c94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239823.597651:0:5787:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: ffff9bb5c0031a00/0x8c5345f1c1ec4c94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239823.597661:0:5787:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff9bb5c0031a00/0x8c5345f1c1ec4c94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782239823.597679:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5e8ecb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758918656:0@lo:101: 00000100:00100000:0.0:1782239823.597730:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239823.597790:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c8460300 going to sleep for 11 seconds 00000100:00100000:2.0:1782239823.597934:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758918656 00000100:00100000:2.0:1782239823.597940:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758918656 00000100:00100000:2.0:1782239823.597981:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1782239823.597989:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8d76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+13:5787:x1868813758918656:12345-0@lo:101: 00010000:00010000:2.0:1782239823.598000:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782239823.598178:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb602045e00/0x8c5345f1c1ec4c9b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c5345f1c1ec4c94 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239823.598215:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb602045e00/0x8c5345f1c1ec4c9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4c94 expref: 14 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239823.598225:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb602045e00/0x8c5345f1c1ec4c9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4c94 expref: 14 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239823.598233:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb602045e00, rc 0) 00000100:00100000:2.0:1782239823.598278:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8d76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+14:5787:x1868813758918656:12345-0@lo:101: Request processed in 290us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239823.598285:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1782239823.598361:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5e8ecb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758918656:0@lo:101: 00010000:00010000:3.0:1782239823.598375:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff9bb5c0031a00/0x8c5345f1c1ec4c94 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4c9b expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239823.598384:0:5787:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff9bb5c0031a00/0x8c5345f1c1ec4c94 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c5345f1c1ec4c9b expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239823.598428:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f780f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758918784:0@lo:501: 00000100:00100000:3.0:1782239823.598453:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239823.598480:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5d1cd0300 going to sleep for 11 seconds 00000100:00100000:1.0:1782239823.598530:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758918784 00000100:00100000:1.0:1782239823.598534:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758918784 00000100:00100000:1.0:1782239823.598561:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1782239823.598573:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8d75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+14:5787:x1868813758918784:12345-0@lo:501: 00000100:00100000:1.0:1782239823.598818:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8d75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+14:5787:x1868813758918784:12345-0@lo:501: Request processed in 245us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239823.598826:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1782239823.598897:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f780f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758918784:0@lo:501: 00000100:00100000:3.0:1782239823.598920:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f780f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758918912:0@lo:503: 00000100:00100000:3.0:1782239823.598953:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239823.598977:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5d1cd0300 going to sleep for 11 seconds 00000100:00100000:1.0:1782239823.599031:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758918912 00000100:00100000:1.0:1782239823.599036:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758918912 00000100:00100000:1.0:1782239823.599063:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1782239823.599068:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8d76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+14:5787:x1868813758918912:12345-0@lo:503: 00000100:00100000:1.0:1782239823.599211:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8d76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+14:5787:x1868813758918912:12345-0@lo:503: Request processed in 141us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239823.599218:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1782239823.599450:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f780f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758918912:0@lo:503: 00000100:00100000:2.0:1782239823.603459:0:8314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5dee24700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:8314:1868813758919040:0@lo:502: 00000100:00100000:2.0:1782239823.603546:0:8314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239823.603591:0:8314:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c7e7c6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782239823.603658:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758919040 00000100:00100000:1.0:1782239823.603665:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758919040 00000100:00100000:1.0:1782239823.603708:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1782239823.603716:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8d74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+14:8314:x1868813758919040:12345-0@lo:502: 00000100:00100000:1.0:1782239823.603956:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8d74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+14:8314:x1868813758919040:12345-0@lo:502: Request processed in 240us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239823.603963:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1782239823.604421:0:8314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5dee24700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:8314:1868813758919040:0@lo:502: 00000020:01000000:3.0:1782239823.604456:0:8314:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782239823.604465:0:8314:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782239823.604467:0:8314:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1782239823.604472:0:8314:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1782239823.604494:0:8314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f780f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:8314:1868813758919168:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782239823.604529:0:8314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239823.604560:0:8314:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5d1cd03c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782239823.604606:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758919168 00000100:00100000:0.0:1782239823.604616:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758919168 00000100:00100000:0.0:1782239823.604650:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1782239823.604656:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8d76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+14:8314:x1868813758919168:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782239823.604811:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8d76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+14:8314:x1868813758919168:12345-0@lo:502:llog_process_th.0 Request processed in 154us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239823.604817:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1782239823.604940:0:8314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f780f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:8314:1868813758919168:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782239823.604958:0:8314:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782239823.604962:0:8314:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782239823.604963:0:8314:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1782239823.604967:0:8314:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:0.0:1782239823.605737:0:5787:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:0.0:1782239823.605795:0:5787:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1782239823.605805:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5c0031a00/0x8c5345f1c1ec4c94 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4c9b expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239823.605817:0:5787:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff9bb5c0031a00/0x8c5345f1c1ec4c94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4c9b expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782239823.605826:0:5787:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1782239823.605828:0:5787:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9bb5c8863000 from 39 10000000:01000000:0.0:1782239823.605831:0:5787:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1782239823.605860:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5c0030400/0x8c5345f1c1ec4ca2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239823.605868:0:5787:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: ffff9bb5c0030400/0x8c5345f1c1ec4ca2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239823.605877:0:5787:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff9bb5c0030400/0x8c5345f1c1ec4ca2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782239823.605895:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5e8eca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758919296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782239823.605939:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239823.605974:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c8460300 going to sleep for 11 seconds 00000100:00100000:2.0:1782239823.606411:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758919296 00000100:00100000:2.0:1782239823.606418:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758919296 00000100:00100000:2.0:1782239823.606462:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1782239823.606470:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8d75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+14:5787:x1868813758919296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782239823.606482:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782239823.606494:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb602044200/0x8c5345f1c1ec4ca9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c5345f1c1ec4ca2 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239823.606516:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb602044200/0x8c5345f1c1ec4ca9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4ca2 expref: 15 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239823.606525:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb602044200/0x8c5345f1c1ec4ca9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4ca2 expref: 15 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239823.606534:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb602044200, rc 0) 00000100:00100000:2.0:1782239823.606587:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8d75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+15:5787:x1868813758919296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (648us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239823.606594:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1782239823.606695:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5e8eca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758919296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782239823.606712:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff9bb5c0030400/0x8c5345f1c1ec4ca2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4ca9 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239823.606721:0:5787:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff9bb5c0030400/0x8c5345f1c1ec4ca2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c5345f1c1ec4ca9 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239823.606804:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb6018ce680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758919424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782239823.606841:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239823.606862:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5e8e80f00 going to sleep for 11 seconds 00000100:00100000:2.0:1782239823.607016:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758919424 00000100:00100000:2.0:1782239823.607021:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758919424 00000100:00100000:2.0:1782239823.607061:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1782239823.607069:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8d75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+15:5787:x1868813758919424:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782239823.607297:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8d75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+15:5787:x1868813758919424:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 228us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239823.607304:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1782239823.607504:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb6018ce680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758919424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782239823.607538:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb6018ce680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758919552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782239823.607575:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239823.607603:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5e8e80f00 going to sleep for 11 seconds 00000100:00100000:3.0:1782239823.607674:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758919552 00000100:00100000:3.0:1782239823.607679:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758919552 00000100:00100000:3.0:1782239823.607714:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1782239823.607721:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8d77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+15:5787:x1868813758919552:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782239823.607882:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8d77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+15:5787:x1868813758919552:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 161us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239823.607889:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1782239823.607980:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb6018ce680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758919552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782239823.608442:0:8315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb6018ce680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:8315:1868813758919680:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782239823.608477:0:8315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239823.608532:0:8315:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5e8e800c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782239823.611367:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758919680 00000100:00100000:3.0:1782239823.611380:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758919680 00000100:00100000:3.0:1782239823.611448:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1782239823.611458:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8d75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+15:8315:x1868813758919680:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782239823.611739:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8d75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+15:8315:x1868813758919680:12345-0@lo:502:llog_process_th.0 Request processed in 282us (3260us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239823.611917:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1782239823.612025:0:8315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb6018ce680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:8315:1868813758919680:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782239823.612094:0:8315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5dee26d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:8315:1868813758919808:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782239823.612135:0:8315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239823.612172:0:8315:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c7e7c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782239823.612227:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758919808 00000100:00100000:1.0:1782239823.612231:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758919808 00000100:00100000:1.0:1782239823.612263:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1782239823.612269:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8d74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+15:8315:x1868813758919808:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782239823.612411:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8d74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+15:8315:x1868813758919808:12345-0@lo:502:llog_process_th.0 Request processed in 141us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239823.612418:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1782239823.612637:0:8315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5dee26d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:8315:1868813758919808:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1782239823.612664:0:8315:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1782239823.618728:0:5787:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1782239823.618780:0:5787:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1782239823.618793:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5c0030400/0x8c5345f1c1ec4ca2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4ca9 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239823.618805:0:5787:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff9bb5c0030400/0x8c5345f1c1ec4ca2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4ca9 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782239823.618815:0:5787:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1782239823.618818:0:5787:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1782239823.618820:0:5787:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1782239823.618858:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5c0031400/0x8c5345f1c1ec4cb0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239823.618866:0:5787:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: ffff9bb5c0031400/0x8c5345f1c1ec4cb0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239823.618876:0:5787:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff9bb5c0031400/0x8c5345f1c1ec4cb0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782239823.618899:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5e8ec9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758919936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782239823.618959:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239823.619014:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c8460c00 going to sleep for 11 seconds 00000100:00100000:3.0:1782239823.619160:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758919936 00000100:00100000:3.0:1782239823.619169:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758919936 00000100:00100000:3.0:1782239823.619224:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1782239823.619234:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8d74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+15:5787:x1868813758919936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782239823.619246:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782239823.619258:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb5c2a45200/0x8c5345f1c1ec4cb7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c5345f1c1ec4cb0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239823.619279:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb5c2a45200/0x8c5345f1c1ec4cb7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4cb0 expref: 16 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239823.619289:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb5c2a45200/0x8c5345f1c1ec4cb7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4cb0 expref: 16 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239823.619297:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5c2a45200, rc 0) 00000100:00100000:3.0:1782239823.619339:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8d74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+16:5787:x1868813758919936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239823.619346:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1782239823.619564:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5e8ec9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758919936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782239823.619579:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff9bb5c0031400/0x8c5345f1c1ec4cb0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4cb7 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239823.619588:0:5787:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff9bb5c0031400/0x8c5345f1c1ec4cb0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c5345f1c1ec4cb7 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782239823.619657:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5e8ec9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758920064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782239823.619683:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239823.619704:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c8460c00 going to sleep for 11 seconds 00000100:00100000:2.0:1782239823.619789:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758920064 00000100:00100000:2.0:1782239823.619793:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758920064 00000100:00100000:2.0:1782239823.619822:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1782239823.619829:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8d74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+16:5787:x1868813758920064:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782239823.620082:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8d74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+16:5787:x1868813758920064:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 253us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239823.620089:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1782239823.620332:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5e8ec9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758920064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782239823.620359:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5e8ec9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758920192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782239823.620397:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239823.620423:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c8460c00 going to sleep for 11 seconds 00000100:00100000:2.0:1782239823.620505:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758920192 00000100:00100000:2.0:1782239823.620510:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758920192 00000100:00100000:2.0:1782239823.620572:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1782239823.620580:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8d77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+16:5787:x1868813758920192:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782239823.620730:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8d77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+16:5787:x1868813758920192:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 151us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239823.620743:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1782239823.620838:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5e8ec9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758920192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782239823.624577:0:8316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5e8ec9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:8316:1868813758920320:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782239823.624663:0:8316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239823.624985:0:8316:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c8460a80 going to sleep for 11 seconds 00000100:00100000:1.0:1782239823.626202:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758920320 00000100:00100000:1.0:1782239823.626214:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758920320 00000100:00100000:1.0:1782239823.626282:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1782239823.626292:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8d77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+16:8316:x1868813758920320:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782239823.626574:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8d77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+16:8316:x1868813758920320:12345-0@lo:502:llog_process_th.0 Request processed in 282us (1909us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239823.626582:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1782239823.628649:0:8316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5e8ec9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:8316:1868813758920320:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1782239823.628695:0:8316:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782239823.628708:0:8316:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782239823.628711:0:8316:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1782239823.628716:0:8316:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1782239823.628803:0:8316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5e8ec9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:8316:1868813758920448:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782239823.628873:0:8316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239823.628908:0:8316:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c8460a80 going to sleep for 11 seconds 00000100:00100000:1.0:1782239823.633343:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758920448 00000100:00100000:1.0:1782239823.633357:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758920448 00000100:00100000:1.0:1782239823.633410:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1782239823.633420:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8d76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+16:8316:x1868813758920448:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782239823.633679:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8d76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+16:8316:x1868813758920448:12345-0@lo:502:llog_process_th.0 Request processed in 261us (4805us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239823.633687:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1782239823.633803:0:8316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5e8ec9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:8316:1868813758920448:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1782239823.633834:0:8316:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782239823.633840:0:8316:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782239823.633842:0:8316:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1782239823.633852:0:8316:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:1.0:1782239823.634264:0:5787:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:1.0:1782239823.634282:0:5787:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1782239823.634291:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5c0031400/0x8c5345f1c1ec4cb0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4cb7 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239823.634302:0:5787:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff9bb5c0031400/0x8c5345f1c1ec4cb0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4cb7 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782239823.634311:0:5787:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1782239823.634313:0:5787:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9bb5c8415000 from 39 10000000:01000000:1.0:1782239823.634316:0:5787:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1782239823.634346:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5c1677200/0x8c5345f1c1ec4cbe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239823.634355:0:5787:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: ffff9bb5c1677200/0x8c5345f1c1ec4cbe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239823.634363:0:5787:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff9bb5c1677200/0x8c5345f1c1ec4cbe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239823.634384:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb6018cf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758920576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782239823.634425:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239823.634467:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5d8124480 going to sleep for 11 seconds 00000100:00100000:1.0:1782239823.634483:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758920576 00000100:00100000:1.0:1782239823.634487:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758920576 00000100:00100000:1.0:1782239823.634512:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1782239823.634518:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8d77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+16:5787:x1868813758920576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782239823.634529:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782239823.634540:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb5c1676a00/0x8c5345f1c1ec4cc5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c5345f1c1ec4cbe expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239823.634561:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb5c1676a00/0x8c5345f1c1ec4cc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4cbe expref: 17 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239823.634571:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb5c1676a00/0x8c5345f1c1ec4cc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4cbe expref: 17 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239823.634579:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5c1676a00, rc 0) 00000100:00100000:1.0:1782239823.634610:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8d77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+17:5787:x1868813758920576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 92us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239823.634616:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1782239823.634650:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb6018cf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758920576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782239823.634662:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff9bb5c1677200/0x8c5345f1c1ec4cbe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4cc5 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239823.634670:0:5787:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff9bb5c1677200/0x8c5345f1c1ec4cbe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c5345f1c1ec4cc5 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239823.634712:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb6018cf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758920704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782239823.634736:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239823.634783:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5d8124480 going to sleep for 11 seconds 00000100:00100000:1.0:1782239823.634795:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758920704 00000100:00100000:1.0:1782239823.634798:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758920704 00000100:00100000:1.0:1782239823.634816:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1782239823.634821:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d1bad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+17:5787:x1868813758920704:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782239823.635058:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d1bad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+17:5787:x1868813758920704:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 216us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239823.635065:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1782239823.635094:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb6018cf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758920704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782239823.635119:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb6018cf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758920832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782239823.635152:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239823.635164:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5d8124480 going to sleep for 11 seconds 00000100:00100000:1.0:1782239823.635175:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758920832 00000100:00100000:1.0:1782239823.635178:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758920832 00000100:00100000:1.0:1782239823.635193:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1782239823.635199:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d1bae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+17:5787:x1868813758920832:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782239823.635320:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d1bae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+17:5787:x1868813758920832:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 121us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239823.635327:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1782239823.635360:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb6018cf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758920832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782239823.649102:0:8317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5e8ec9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:8317:1868813758920960:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782239823.649187:0:8317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239823.649238:0:8317:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c8460900 going to sleep for 11 seconds 00000100:00100000:2.0:1782239823.649268:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758920960 00000100:00100000:2.0:1782239823.649283:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758920960 00000100:00100000:2.0:1782239823.649369:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1782239823.649386:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d1bac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+17:8317:x1868813758920960:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782239823.649856:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d1bac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+17:8317:x1868813758920960:12345-0@lo:502:llog_process_th.0 Request processed in 472us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239823.649867:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1782239823.649891:0:8317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5e8ec9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:8317:1868813758920960:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782239823.649960:0:8317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5e8ec9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:8317:1868813758921088:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782239823.650017:0:8317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239823.650046:0:8317:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c8460900 going to sleep for 11 seconds 00000100:00100000:3.0:1782239823.651060:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758921088 00000100:00100000:3.0:1782239823.651070:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758921088 00000100:00100000:3.0:1782239823.651122:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1782239823.651132:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d1baec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+17:8317:x1868813758921088:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782239823.651394:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d1baec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+17:8317:x1868813758921088:12345-0@lo:502:llog_process_th.0 Request processed in 263us (1376us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239823.651401:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1782239823.652017:0:8317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5e8ec9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:8317:1868813758921088:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1782239823.652059:0:8317:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1782239823.652252:0:5787:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1782239823.652671:0:5787:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1782239823.652686:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5c1677200/0x8c5345f1c1ec4cbe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4cc5 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239823.652700:0:5787:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff9bb5c1677200/0x8c5345f1c1ec4cbe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4cc5 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782239823.652712:0:5787:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1782239823.652714:0:5787:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1782239823.652718:0:5787:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1782239823.652814:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb602044600/0x8c5345f1c1ec4ccc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239823.652825:0:5787:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: ffff9bb602044600/0x8c5345f1c1ec4ccc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239823.652837:0:5787:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff9bb602044600/0x8c5345f1c1ec4ccc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239823.652867:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5dee26300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758921216:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782239823.652968:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239823.653928:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c7e7c840 going to sleep for 11 seconds 00000100:00100000:1.0:1782239823.664408:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758921216 00000100:00100000:1.0:1782239823.664423:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758921216 00000100:00100000:1.0:1782239823.664478:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1782239823.664487:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d1bad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+17:5787:x1868813758921216:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782239823.664517:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782239823.664534:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb5c1676000/0x8c5345f1c1ec4cd3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c5345f1c1ec4ccc expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239823.664560:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb5c1676000/0x8c5345f1c1ec4cd3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4ccc expref: 18 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239823.664570:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb5c1676000/0x8c5345f1c1ec4cd3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4ccc expref: 18 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239823.664579:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5c1676000, rc 0) 00000100:00100000:1.0:1782239823.664643:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d1bad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+18:5787:x1868813758921216:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 157us (11676us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239823.664650:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1782239823.664796:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5dee26300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758921216:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782239823.664815:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff9bb602044600/0x8c5345f1c1ec4ccc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4cd3 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239823.664824:0:5787:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff9bb602044600/0x8c5345f1c1ec4ccc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c5345f1c1ec4cd3 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239823.664893:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5dee26300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758921344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782239823.664927:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239823.664965:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c7e7c840 going to sleep for 11 seconds 00000100:00100000:0.0:1782239823.665124:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758921344 00000100:00100000:0.0:1782239823.665130:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758921344 00000100:00100000:0.0:1782239823.665163:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1782239823.665171:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d1bad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+18:5787:x1868813758921344:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782239823.666237:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d1bad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+18:5787:x1868813758921344:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1061us (1303us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239823.666247:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1782239823.669190:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5dee26300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758921344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782239823.669273:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f780f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758921472:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782239823.669342:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239823.669398:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5d1cd0780 going to sleep for 11 seconds 00000100:00100000:0.0:1782239823.671171:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758921472 00000100:00100000:0.0:1782239823.671183:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758921472 00000100:00100000:0.0:1782239823.671241:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1782239823.671251:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d1baf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+18:5787:x1868813758921472:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782239823.671645:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d1baf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+18:5787:x1868813758921472:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 395us (2301us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239823.671654:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1782239823.672237:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f780f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758921472:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782239823.673010:0:8318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f780f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:8318:1868813758921600:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782239823.673086:0:8318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239823.673201:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758921600 00000100:00100000:0.0:1782239823.673207:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758921600 00000100:00100000:0.0:1782239823.673248:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1782239823.673250:0:8318:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5d1cd0540 going to sleep for 11 seconds 00000100:00100000:0.0:1782239823.673257:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d1badc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+18:8318:x1868813758921600:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782239823.674577:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d1badc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+18:8318:x1868813758921600:12345-0@lo:502:llog_process_th.0 Request processed in 1315us (1485us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239823.674590:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1782239823.674737:0:8318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f780f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:8318:1868813758921600:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782239823.674783:0:8318:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782239823.674792:0:8318:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782239823.674794:0:8318:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1782239823.674801:0:8318:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1782239823.674838:0:8318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f780f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:8318:1868813758921728:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782239823.674881:0:8318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239823.674917:0:8318:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5d1cd0540 going to sleep for 11 seconds 00000100:00100000:1.0:1782239823.674970:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758921728 00000100:00100000:1.0:1782239823.674976:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758921728 00000100:00100000:1.0:1782239823.675015:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1782239823.675023:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d1bac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+18:8318:x1868813758921728:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782239823.675240:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d1bac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+18:8318:x1868813758921728:12345-0@lo:502:llog_process_th.0 Request processed in 217us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239823.675248:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1782239823.675366:0:8318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f780f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:8318:1868813758921728:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782239823.675384:0:8318:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782239823.675481:0:8318:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782239823.675482:0:8318:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1782239823.675486:0:8318:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1782239823.675668:0:5787:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:2.0:1782239823.675692:0:5787:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1782239823.675701:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb602044600/0x8c5345f1c1ec4ccc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4cd3 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239823.675712:0:5787:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff9bb602044600/0x8c5345f1c1ec4ccc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4cd3 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782239823.675722:0:5787:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1782239823.675724:0:5787:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff9bb5d1bd99c0 from 1 10000000:01000000:2.0:1782239823.675727:0:5787:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1782239823.675779:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5ee29f000/0x8c5345f1c1ec4cda lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239823.675808:0:5787:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: ffff9bb5ee29f000/0x8c5345f1c1ec4cda lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239823.675818:0:5787:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff9bb5ee29f000/0x8c5345f1c1ec4cda lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239823.675834:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5dee24a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758921856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782239823.675868:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239823.675952:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c7e7c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782239823.681186:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758921856 00000100:00100000:0.0:1782239823.681203:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758921856 00000100:00100000:0.0:1782239823.681317:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1782239823.681327:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d1bacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+18:5787:x1868813758921856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782239823.681342:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782239823.681360:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb5c0031200/0x8c5345f1c1ec4ce1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c5345f1c1ec4cda expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239823.681553:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb5c0031200/0x8c5345f1c1ec4ce1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4cda expref: 19 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239823.681563:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb5c0031200/0x8c5345f1c1ec4ce1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4cda expref: 19 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239823.681571:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5c0031200, rc 0) 00000100:00100000:0.0:1782239823.681679:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d1bacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:5787:x1868813758921856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 355us (5810us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239823.681686:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1782239823.681872:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5dee24a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758921856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782239823.681891:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff9bb5ee29f000/0x8c5345f1c1ec4cda lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4ce1 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239823.681900:0:5787:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff9bb5ee29f000/0x8c5345f1c1ec4cda lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c5345f1c1ec4ce1 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239823.681967:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5dee24a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758921984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782239823.681998:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239823.682034:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c7e7c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782239823.682066:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758921984 00000100:00100000:3.0:1782239823.682071:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758921984 00000100:00100000:3.0:1782239823.682135:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1782239823.682144:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d1bac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:5787:x1868813758921984:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782239823.682381:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d1bac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:5787:x1868813758921984:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 237us (381us total) trans 0 rc -2/-2 00000100:00100000:3.0:1782239823.682396:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1782239823.682463:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5dee24a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758921984:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1782239823.682490:0:5787:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1782239823.682497:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5ee29f000/0x8c5345f1c1ec4cda lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4ce1 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239823.682506:0:5787:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff9bb5ee29f000/0x8c5345f1c1ec4cda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4ce1 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239824.095101:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782239825.119121:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782239825.183227:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5dee24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1868813758922112:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782239825.183294:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239825.183415:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758922112 00000100:00100000:0.0:1782239825.183434:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758922112 00000100:00100000:0.0:1782239825.183499:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1782239825.183508:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb6018cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1868813758922112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782239825.183543:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782239825.183588:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb6018cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1868813758922112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239825.183595:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1782239825.183682:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb5dee24a80 x1868813758922112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782239841 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782239825.183700:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5dee24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1868813758922112:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1782239825.183815:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1782239826.143140:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782239826.207979:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5e8ecad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1868813758922624:0@lo:400:kworker.0 00000100:00100000:0.0:1782239826.207987:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5e8ec9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1868813758922496:0@lo:400:kworker.0 00000100:00100000:3.0:1782239826.207992:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5e8ecb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3305:1868813758922240:0@lo:400:kworker.0 00000100:00100000:2.0:1782239826.208097:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5e8ec8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1868813758922368:0@lo:400:kworker.0 00000100:00100000:3.0:1782239826.209971:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239826.210058:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5e8ec9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1868813758922752:0@lo:400:kworker.0 00000100:00100000:3.0:1782239826.210093:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239826.210152:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758922752 00000100:00100000:3.0:1782239826.210161:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758922752 00000100:00100000:3.0:1782239826.210237:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1782239826.210248:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f780f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1868813758922752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782239826.210304:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f780f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1868813758922752:12345-0@lo:400:kworker.0 Request processed in 59us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239826.210312:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:3.0:1782239826.210345:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782239826.210372:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5e8ec9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1868813758922752:0@lo:400:kworker.0 00000100:00100000:3.0:1782239826.210414:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758922240 00000100:00100000:3.0:1782239826.210417:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758922240 00000100:00100000:3.0:1782239826.210443:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1782239826.210449:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d1bafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:3305:x1868813758922240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782239826.210484:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d1bafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:3305:x1868813758922240:12345-0@lo:400:kworker.0 Request processed in 35us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239826.210491:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1782239826.210523:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5e8ecb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3305:1868813758922240:0@lo:400:kworker.0 00000100:00100000:0.0:1782239826.211860:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239826.212524:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239826.212685:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758922624 00000100:00100000:0.0:1782239826.212696:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758922624 00000100:00100000:0.0:1782239826.212778:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1782239826.212789:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb6018ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1868813758922624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782239826.212862:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb6018ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1868813758922624:12345-0@lo:400:kworker.0 Request processed in 75us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239826.212870:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1782239826.212918:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb5e8ecad80 x1868813758922624/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782239842 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782239826.212934:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5e8ecad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1868813758922624:0@lo:400:kworker.0 00000100:00100000:3.0:1782239826.214048:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758922496 00000100:00100000:3.0:1782239826.214061:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758922496 00000100:00100000:3.0:1782239826.214144:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1782239826.214155:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8ecb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1868813758922496:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1782239826.214165:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782239826.214257:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8ecb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1868813758922496:12345-0@lo:400:kworker.0 Request processed in 102us (2398us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239826.214265:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1782239826.214485:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5e8ec9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1868813758922496:0@lo:400:kworker.0 00000100:00100000:2.0:1782239826.218390:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239826.218442:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5e8eca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813758922880:0@lo:400:kworker.0 00000100:00100000:2.0:1782239826.218473:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239826.218646:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758922880 00000100:00100000:0.0:1782239826.218654:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758922880 00000100:00100000:0.0:1782239826.218712:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1782239826.218730:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5dee24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1868813758922880:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1782239826.218792:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782239826.218831:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5dee24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1868813758922880:12345-0@lo:400:kworker.0 Request processed in 97us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239826.218840:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1782239826.218906:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb5e8eca680 x1868813758922880/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782239842 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782239826.218926:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5e8eca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813758922880:0@lo:400:kworker.0 00000100:00100000:3.0:1782239826.219039:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758922368 00000100:00100000:3.0:1782239826.219044:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758922368 00000100:00100000:3.0:1782239826.219083:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1782239826.219090:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5dee25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1868813758922368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782239826.219126:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5dee25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1868813758922368:12345-0@lo:400:kworker.0 Request processed in 37us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239826.219132:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1782239826.220744:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5e8ec8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1868813758922368:0@lo:400:kworker.0 00000100:00100000:3.0:1782239826.720851:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782239826.720882:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5dee26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813758923008:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782239826.720951:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239826.721204:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758923008 00000100:00100000:2.0:1782239826.721213:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758923008 00000100:00100000:2.0:1782239826.721271:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1782239826.721281:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f780dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1868813758923008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782239826.721320:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782239826.721376:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f780dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1868813758923008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239826.721383:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1782239826.721633:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb5dee26300 x1868813758923008/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782239842 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782239826.721652:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5dee26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813758923008:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782239827.167151:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782239827.478648:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239827.478831:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737923328 00000100:00100000:3.0:1782239827.478845:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737923328 00000100:00100000:3.0:1782239827.478952:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 164 00000100:00100000:3.0:1782239827.478963:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d1baf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afaefb1a-536b-42a3-a3ff-47200f8611c3+8:5567:x1868813737923328:12345-192.168.203.32@tcp:101: 00010000:00010000:3.0:1782239827.478986:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782239827.479035:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb5c2a45c00/0x8c5345f1c1ec4ce8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e3dc expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239827.479072:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb5c2a45c00/0x8c5345f1c1ec4ce8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e3dc expref: 9 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239827.479085:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb5c2a45c00/0x8c5345f1c1ec4ce8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e3dc expref: 9 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239827.479095:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5c2a45c00, rc 0) 00000100:00100000:3.0:1782239827.479166:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d1baf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afaefb1a-536b-42a3-a3ff-47200f8611c3+9:5567:x1868813737923328:12345-192.168.203.32@tcp:101: Request processed in 204us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239827.479174:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 164 00000100:00100000:0.0:1782239827.483826:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239827.485005:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737923456 00000100:00100000:3.0:1782239827.485027:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737923456 00000100:00100000:3.0:1782239827.485093:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 165 00000100:00100000:3.0:1782239827.485104:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d1bae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afaefb1a-536b-42a3-a3ff-47200f8611c3+9:5567:x1868813737923456:12345-192.168.203.32@tcp:501: 00000100:00100000:3.0:1782239827.486671:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d1bae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afaefb1a-536b-42a3-a3ff-47200f8611c3+9:5567:x1868813737923456:12345-192.168.203.32@tcp:501: Request processed in 1562us (2845us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239827.486684:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 165 00000100:00100000:2.0:1782239827.504888:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239827.505447:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737923584 00000100:00100000:3.0:1782239827.505462:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737923584 00000100:00100000:3.0:1782239827.505608:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 166 00000100:00100000:3.0:1782239827.505621:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d1baf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afaefb1a-536b-42a3-a3ff-47200f8611c3+9:5567:x1868813737923584:12345-192.168.203.32@tcp:503: 00000100:00100000:3.0:1782239827.506035:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d1baf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afaefb1a-536b-42a3-a3ff-47200f8611c3+9:5567:x1868813737923584:12345-192.168.203.32@tcp:503: Request processed in 415us (1159us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239827.506046:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 166 00000100:00100000:0.0:1782239827.513410:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239827.514490:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737923712 00000100:00100000:3.0:1782239827.514519:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737923712 00000100:00100000:3.0:1782239827.514675:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 167 00000100:00100000:3.0:1782239827.514686:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d1bae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afaefb1a-536b-42a3-a3ff-47200f8611c3+9:6057:x1868813737923712:12345-192.168.203.32@tcp:502: 00000100:00100000:3.0:1782239827.514967:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d1bae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afaefb1a-536b-42a3-a3ff-47200f8611c3+9:6057:x1868813737923712:12345-192.168.203.32@tcp:502: Request processed in 282us (1566us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239827.514975:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 167 00000100:00100000:1.0:1782239827.519504:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239827.519673:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737923840 00000100:00100000:3.0:1782239827.519683:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737923840 00000100:00100000:3.0:1782239827.519805:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 168 00000100:00100000:3.0:1782239827.519816:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5decbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afaefb1a-536b-42a3-a3ff-47200f8611c3+9:6057:x1868813737923840:12345-192.168.203.32@tcp:502:llog_process_th.0 00000100:00100000:3.0:1782239827.520119:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5decbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afaefb1a-536b-42a3-a3ff-47200f8611c3+9:6057:x1868813737923840:12345-192.168.203.32@tcp:502:llog_process_th.0 Request processed in 304us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239827.520127:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 168 00000100:00100000:2.0:1782239827.542984:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239827.543162:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737923968 00000100:00100000:3.0:1782239827.543172:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737923968 00000100:00100000:3.0:1782239827.543396:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 169 00000100:00100000:3.0:1782239827.543405:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5decbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afaefb1a-536b-42a3-a3ff-47200f8611c3+9:5567:x1868813737923968:12345-192.168.203.32@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782239827.543420:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782239827.543436:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb5c2a45a00/0x8c5345f1c1ec4cef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e3e3 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239827.543465:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb5c2a45a00/0x8c5345f1c1ec4cef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e3e3 expref: 10 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239827.543959:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb5c2a45a00/0x8c5345f1c1ec4cef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e3e3 expref: 10 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239827.543987:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5c2a45a00, rc 0) 00000100:00100000:2.0:1782239827.544170:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5decbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afaefb1a-536b-42a3-a3ff-47200f8611c3+10:5567:x1868813737923968:12345-192.168.203.32@tcp:101:ll_cfg_requeue.0 Request processed in 764us (1194us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239827.544178:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 169 00000100:00100000:1.0:1782239827.550811:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239827.551062:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737924096 00000100:00100000:3.0:1782239827.551073:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737924096 00000100:00100000:3.0:1782239827.551233:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 170 00000100:00100000:3.0:1782239827.551244:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5decbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afaefb1a-536b-42a3-a3ff-47200f8611c3+10:5567:x1868813737924096:12345-192.168.203.32@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782239827.551533:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5decbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afaefb1a-536b-42a3-a3ff-47200f8611c3+10:5567:x1868813737924096:12345-192.168.203.32@tcp:501:ll_cfg_requeue.0 Request processed in 290us (729us total) trans 0 rc -2/-2 00000100:00100000:3.0:1782239827.551542:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 170 00000100:00100000:1.0:1782239827.991373:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239827.991416:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239827.991447:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239827.991480:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737924480 00000100:00100000:1.0:1782239827.991490:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737924480 00000100:00100000:1.0:1782239827.991549:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737924352 00000100:00100000:1.0:1782239827.991552:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737924352 00000100:00100000:1.0:1782239827.991576:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 15 00000100:00100000:1.0:1782239827.991586:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+5:2345:x1868813737924480:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:1.0:1782239827.991661:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+5:2345:x1868813737924480:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 75us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239827.991669:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 15 00000100:00100000:1.0:1782239827.991685:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 16 00000100:00100000:1.0:1782239827.991691:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+5:2345:x1868813737924352:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:1.0:1782239827.991716:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+5:2345:x1868813737924352:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 25us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239827.991728:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 16 00000100:00080000:1.0:1782239827.991887:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782239827.991892:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782239827.992633:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737924224 00000100:00100000:3.0:1782239827.992641:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737924224 00000100:00100000:3.0:1782239827.992698:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 31 00000100:00100000:3.0:1782239827.992705:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+6:2345:x1868813737924224:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:3.0:1782239827.992781:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+6:2345:x1868813737924224:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 76us (1419us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239827.992788:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 31 00000100:00080000:1.0:1782239827.995589:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1782239828.194654:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1782239828.478108:0:8359:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd94364740 20000000:00000080:2.0:1782239828.478126:0:8359:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9bb5edf3d000 uarg=0000000000000000 20000000:01000000:2.0:1782239828.478162:0:8359:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1782239828.478167:0:8359:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1782239828.478172:0:8359:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1782239828.482977:0:8360:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:2.0:1782239828.483412:0:8359:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:2.0:1782239828.496592:0:8359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:2.0:1782239828.496650:0:8359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:2.0:1782239828.496718:0:8359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:2.0:1782239828.496735:0:8359:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1782239828.496874:0:8359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bb5ee29fe00/0x8c5345f1c1ec4cf6 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239828.496896:0:8359:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bb602044000/0x8c5345f1c1ec4a6b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4a64 expref: 18 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239828.496904:0:8359:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bb5c1677e00/0x8c5345f1c1ec4acd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4ac6 expref: 18 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239828.496910:0:8359:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bb602044e00/0x8c5345f1c1ec4b98 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4b91 expref: 18 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239828.496919:0:8359:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bb602044a00/0x8c5345f1c1ec4c55 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e3ab expref: 9 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239828.496927:0:8359:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bb5ee29fe00/0x8c5345f1c1ec4cf6 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239828.496970:0:8359:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bb602044a00/0x8c5345f1c1ec4c55 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e3ab expref: 9 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239828.496986:0:8359:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bb602044a00/0x8c5345f1c1ec4c55 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e3ab expref: 9 pid: 5783 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239828.497014:0:8359:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5dee26d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8359:1868813758923136:192.168.203.32@tcp:104: 00010000:00010000:2.0:1782239828.497115:0:8359:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bb602044e00/0x8c5345f1c1ec4b98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8c5345f1c1ec4b91 expref: 18 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239828.497124:0:8359:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bb602044e00/0x8c5345f1c1ec4b98 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8c5345f1c1ec4b91 expref: 18 pid: 5783 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239828.497140:0:8359:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5dee24700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8359:1868813758923264:0@lo:104: 00000100:00100000:2.0:1782239828.497184:0:8359:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782239828.497217:0:8359:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bb5c1677e00/0x8c5345f1c1ec4acd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8c5345f1c1ec4ac6 expref: 18 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239828.497238:0:8359:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bb5c1677e00/0x8c5345f1c1ec4acd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8c5345f1c1ec4ac6 expref: 18 pid: 5785 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239828.497246:0:8359:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5dee24380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8359:1868813758923392:0@lo:104: 00000100:00100000:2.0:1782239828.497268:0:8359:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782239828.499537:0:8359:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bb602044000/0x8c5345f1c1ec4a6b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8c5345f1c1ec4a64 expref: 18 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239828.499556:0:8359:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bb602044000/0x8c5345f1c1ec4a6b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8c5345f1c1ec4a64 expref: 18 pid: 5785 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239828.499570:0:8359:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5dee26680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8359:1868813758923520:0@lo:104: 00000100:00100000:2.0:1782239828.499609:0:8359:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c84b9e40 going to sleep for 11 seconds 00000100:00100000:3.0:1782239828.503469:0:8359:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5dee26d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8359:1868813758923136:192.168.203.32@tcp:104: 00000100:00100000:1.0:1782239828.503569:0:5774:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1782239828.503600:0:5774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239828.503621:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758923264 00000100:00100000:1.0:1782239828.503629:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758923264 00000100:00100000:1.0:1782239828.503668:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758923392 00000100:00100000:1.0:1782239828.503672:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758923392 00000100:00100000:1.0:1782239828.503682:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758923520 00000100:00100000:1.0:1782239828.503684:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758923520 00000100:00100000:1.0:1782239828.503697:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1782239828.503706:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5dee25c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+5:8359:x1868813758923264:12345-0@lo:104: 00010000:00010000:1.0:1782239828.503721:0:5774:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.132@tcp lock: ffff9bb602045000/0x8c5345f1c1ec4b91 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c5345f1c1ec4b98 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239828.503827:0:5774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782239828.503833:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5dee25c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+5:8359:x1868813758923264:12345-0@lo:104: Request processed in 129us (6649us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239828.503840:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1782239828.503858:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1782239828.503865:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7c8f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+4:8359:x1868813758923392:12345-0@lo:104: 00010000:00010000:1.0:1782239828.503873:0:5774:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.132@tcp lock: ffff9bb5c0030a00/0x8c5345f1c1ec4ac6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c5345f1c1ec4acd expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239828.503906:0:5774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1782239828.503924:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7c8f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+4:8359:x1868813758923392:12345-0@lo:104: Request processed in 60us (6654us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239828.503930:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1782239828.503966:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1782239828.503973:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48ec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+3:8359:x1868813758923520:12345-0@lo:104: 00010000:00010000:1.0:1782239828.503981:0:5774:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.132@tcp lock: ffff9bb5c0030800/0x8c5345f1c1ec4a64 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c5345f1c1ec4a6b expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239828.504024:0:5774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1782239828.504029:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48ec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+3:8359:x1868813758923520:12345-0@lo:104: Request processed in 57us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239828.504035:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:0.0:1782239828.504146:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1782239828.504153:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.132@tcp lock: ffff9bb602045000/0x8c5345f1c1ec4b91 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c5345f1c1ec4b98 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239828.504162:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb602045000 already unused, calling callback (ffffffffc1d0cc20) 10000000:00010000:0.0:1782239828.504173:0:5779:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.132@tcp lock: ffff9bb602045000/0x8c5345f1c1ec4b91 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8c5345f1c1ec4b98 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239828.504183:0:5779:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.132@tcp lock: ffff9bb602045000/0x8c5345f1c1ec4b91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8c5345f1c1ec4b98 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782239828.504191:0:5779:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.132@tcp lock: ffff9bb602045000/0x8c5345f1c1ec4b91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8c5345f1c1ec4b98 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782239828.504197:0:5779:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1782239828.504243:0:5779:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.132@tcp lock: ffff9bb602045000/0x8c5345f1c1ec4b91 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c5345f1c1ec4b98 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239828.504250:0:5779:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782239828.504270:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.132@tcp lock: ffff9bb602045000/0x8c5345f1c1ec4b91 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c5345f1c1ec4b98 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239828.504277:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.132@tcp lock: ffff9bb602045000/0x8c5345f1c1ec4b91 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c5345f1c1ec4b98 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239828.504290:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782239828.504293:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.132@tcp lock: ffff9bb5c0030a00/0x8c5345f1c1ec4ac6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c5345f1c1ec4acd expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239828.504299:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5c0030a00 already unused, calling callback (ffffffffc1d0cc20) 10000000:00010000:0.0:1782239828.504302:0:5779:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.132@tcp lock: ffff9bb5c0030a00/0x8c5345f1c1ec4ac6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8c5345f1c1ec4acd expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239828.504308:0:5779:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.132@tcp lock: ffff9bb5c0030a00/0x8c5345f1c1ec4ac6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8c5345f1c1ec4acd expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782239828.504325:0:5779:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.132@tcp lock: ffff9bb5c0030a00/0x8c5345f1c1ec4ac6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8c5345f1c1ec4acd expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782239828.504330:0:5779:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1782239828.504343:0:5779:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.132@tcp lock: ffff9bb5c0030a00/0x8c5345f1c1ec4ac6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c5345f1c1ec4acd expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239828.504349:0:5779:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782239828.504355:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.132@tcp lock: ffff9bb5c0030a00/0x8c5345f1c1ec4ac6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c5345f1c1ec4acd expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239828.504361:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.132@tcp lock: ffff9bb5c0030a00/0x8c5345f1c1ec4ac6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c5345f1c1ec4acd expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239828.504371:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782239828.504373:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.132@tcp lock: ffff9bb5c0030800/0x8c5345f1c1ec4a64 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c5345f1c1ec4a6b expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239828.504379:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5c0030800 already unused, calling callback (ffffffffc1d0cc20) 10000000:00010000:0.0:1782239828.504382:0:5779:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.132@tcp lock: ffff9bb5c0030800/0x8c5345f1c1ec4a64 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8c5345f1c1ec4a6b expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239828.504388:0:5779:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.132@tcp lock: ffff9bb5c0030800/0x8c5345f1c1ec4a64 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8c5345f1c1ec4a6b expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782239828.504394:0:5779:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.132@tcp lock: ffff9bb5c0030800/0x8c5345f1c1ec4a64 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8c5345f1c1ec4a6b expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782239828.504400:0:5779:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1782239828.504418:0:5779:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.132@tcp lock: ffff9bb5c0030800/0x8c5345f1c1ec4a64 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c5345f1c1ec4a6b expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239828.504424:0:5779:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782239828.504438:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.132@tcp lock: ffff9bb5c0030800/0x8c5345f1c1ec4a64 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c5345f1c1ec4a6b expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239828.504444:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.132@tcp lock: ffff9bb5c0030800/0x8c5345f1c1ec4a64 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c5345f1c1ec4a6b expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239828.504456:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782239828.504458:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782239828.504460:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782239828.504466:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782239828.504478:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5e8ecad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3304:1868813758923648:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782239828.504516:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239828.504549:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782239828.504554:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5e8ec8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3304:1868813758923776:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782239828.504572:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239828.504595:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5e8ec8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3306:1868813758923904:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782239828.504613:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239828.504643:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758923648 00000100:00100000:0.0:1782239828.504647:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758923648 00010000:00010000:0.0:1782239828.504669:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bb602044e00/0x8c5345f1c1ec4b98 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c5345f1c1ec4b91 expref: 19 pid: 5783 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782239828.504689:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758923776 00000100:00100000:0.0:1782239828.504692:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758923776 00010000:00010000:0.0:1782239828.504702:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bb5c1677e00/0x8c5345f1c1ec4acd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c5345f1c1ec4ac6 expref: 20 pid: 5785 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782239828.504726:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758923904 00000100:00100000:0.0:1782239828.504728:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758923904 00010000:00010000:0.0:1782239828.504739:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bb602044000/0x8c5345f1c1ec4a6b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c5345f1c1ec4a64 expref: 21 pid: 5785 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782239828.504774:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1782239828.504781:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8ec8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+21:3304:x1868813758923648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782239828.504792:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782239828.504797:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bb602044e00/0x8c5345f1c1ec4b98 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c5345f1c1ec4b91 expref: 21 pid: 5783 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239828.504806:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bb602044e00/0x8c5345f1c1ec4b98 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8c5345f1c1ec4b91 expref: 21 pid: 5783 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239828.504835:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782239828.504866:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8ec8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+21:3304:x1868813758923648:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239828.504873:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1782239828.504887:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1782239828.504893:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8eca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+20:3304:x1868813758923776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782239828.504901:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782239828.504905:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bb5c1677e00/0x8c5345f1c1ec4acd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c5345f1c1ec4ac6 expref: 20 pid: 5785 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239828.504912:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bb5c1677e00/0x8c5345f1c1ec4acd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8c5345f1c1ec4ac6 expref: 20 pid: 5785 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239828.504921:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782239828.504946:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8eca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+20:3304:x1868813758923776:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239828.504952:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1782239828.504963:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1782239828.504968:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8ec9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:3306:x1868813758923904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782239828.504976:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782239828.504980:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bb602044000/0x8c5345f1c1ec4a6b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c5345f1c1ec4a64 expref: 19 pid: 5785 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239828.504988:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bb602044000/0x8c5345f1c1ec4a6b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8c5345f1c1ec4a64 expref: 19 pid: 5785 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239828.504996:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782239828.505032:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8ec9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:3306:x1868813758923904:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239828.505038:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1782239828.505074:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5e8ec8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3304:1868813758923776:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782239828.505081:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5e8ecad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3304:1868813758923648:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782239828.505103:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5e8ec8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3306:1868813758923904:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782239828.505437:0:8359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb602044e00/0x8c5345f1c1ec4b98 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8c5345f1c1ec4b91 expref: 18 pid: 5783 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239828.505449:0:8359:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5dee24700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8359:1868813758923264:0@lo:104: 00010000:00010000:3.0:1782239828.505459:0:8359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb5c1677e00/0x8c5345f1c1ec4acd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8c5345f1c1ec4ac6 expref: 17 pid: 5785 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239828.505467:0:8359:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5dee24380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8359:1868813758923392:0@lo:104: 00010000:00010000:3.0:1782239828.505490:0:8359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb602044000/0x8c5345f1c1ec4a6b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8c5345f1c1ec4a64 expref: 16 pid: 5785 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239828.505498:0:8359:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5dee26680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8359:1868813758923520:0@lo:104: 00010000:00010000:3.0:1782239828.505522:0:8359:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bb5ee29fe00/0x8c5345f1c1ec4cf6 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239828.509694:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239828.514350:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737924608 00000100:00100000:0.0:1782239828.514365:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737924608 00010000:00010000:0.0:1782239828.514415:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bb602044a00/0x8c5345f1c1ec4c55 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e3ab expref: 10 pid: 5783 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782239828.514457:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 24 00000100:00100000:0.0:1782239828.514467:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f780ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:afaefb1a-536b-42a3-a3ff-47200f8611c3+10:2344:x1868813737924608:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782239828.514483:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782239828.514501:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bb602044a00/0x8c5345f1c1ec4c55 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e3ab expref: 10 pid: 5783 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239828.514514:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bb602044a00/0x8c5345f1c1ec4c55 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e3ab expref: 10 pid: 5783 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239828.514530:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb602044a00/0x8c5345f1c1ec4c55 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e3ab expref: 10 pid: 5783 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239828.514549:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bb5ee29fe00/0x8c5345f1c1ec4cf6 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239828.514557:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb5ee29fe00/0x8c5345f1c1ec4cf6 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239828.514573:0:5775:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bb5ee29fe00/0x8c5345f1c1ec4cf6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239828.514578:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bb5ee29fe00/0x8c5345f1c1ec4cf6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239828.514584:0:5775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bb5ee29fe00/0x8c5345f1c1ec4cf6 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239828.514590:0:5775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bb5ee29fe00/0x8c5345f1c1ec4cf6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239828.514595:0:5775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5ee29fe00 already unused, calling callback (ffffffffc1728ce0) 00010000:00010000:0.0:1782239828.514599:0:5775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bb5ee29fe00/0x8c5345f1c1ec4cf6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239828.514605:0:5775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bb5ee29fe00/0x8c5345f1c1ec4cf6 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239828.514634:0:5775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bb5ee29fe00/0x8c5345f1c1ec4cf6 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239828.514645:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782239828.514696:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f780ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:afaefb1a-536b-42a3-a3ff-47200f8611c3+9:2344:x1868813737924608:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 231us (5012us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239828.514704:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 24 00010000:00010000:1.0:1782239828.514907:0:8359:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bb5ee29fe00/0x8c5345f1c1ec4cf6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239828.514916:0:8359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bb5ee29fe00/0x8c5345f1c1ec4cf6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239828.514922:0:8359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb5ee29fe00/0x8c5345f1c1ec4cf6 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239828.931175:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239828.931455:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737924736 00000100:00100000:2.0:1782239828.931469:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737924736 00000100:00100000:2.0:1782239828.931546:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 171 00000100:00100000:2.0:1782239828.931558:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5decbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afaefb1a-536b-42a3-a3ff-47200f8611c3+9:5567:x1868813737924736:12345-192.168.203.32@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782239828.931581:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782239828.931605:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb5ee29e000/0x8c5345f1c1ec4cfd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e3ea expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239828.931639:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb5ee29e000/0x8c5345f1c1ec4cfd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e3ea expref: 10 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239828.931668:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb5ee29e000/0x8c5345f1c1ec4cfd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e3ea expref: 10 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239828.931679:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5ee29e000, rc 0) 00000100:00100000:2.0:1782239828.931802:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5decbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afaefb1a-536b-42a3-a3ff-47200f8611c3+10:5567:x1868813737924736:12345-192.168.203.32@tcp:101:ll_cfg_requeue.0 Request processed in 246us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239828.931810:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 171 00000100:00100000:0.0:1782239828.940079:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239828.940182:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737924864 00000100:00100000:3.0:1782239828.940196:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737924864 00000100:00100000:3.0:1782239828.940272:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 172 00000100:00100000:3.0:1782239828.940285:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5decbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afaefb1a-536b-42a3-a3ff-47200f8611c3+10:5567:x1868813737924864:12345-192.168.203.32@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782239828.940741:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5decbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afaefb1a-536b-42a3-a3ff-47200f8611c3+10:5567:x1868813737924864:12345-192.168.203.32@tcp:501:ll_cfg_requeue.0 Request processed in 457us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239828.940792:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 172 00000100:00100000:3.0:1782239828.947198:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239828.947308:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737924992 00000100:00100000:0.0:1782239828.947326:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737924992 00000100:00100000:0.0:1782239828.947867:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 173 00000100:00100000:0.0:1782239828.947880:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5decbc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afaefb1a-536b-42a3-a3ff-47200f8611c3+10:5567:x1868813737924992:12345-192.168.203.32@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782239828.950256:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5decbc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afaefb1a-536b-42a3-a3ff-47200f8611c3+10:5567:x1868813737924992:12345-192.168.203.32@tcp:503:ll_cfg_requeue.0 Request processed in 1463us (2152us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239828.950274:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 173 00000100:00100000:1.0:1782239828.968266:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239828.970563:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737925120 00000100:00100000:2.0:1782239828.970583:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737925120 00000100:00100000:2.0:1782239828.970688:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 174 00000100:00100000:2.0:1782239828.970702:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5decbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afaefb1a-536b-42a3-a3ff-47200f8611c3+10:6103:x1868813737925120:12345-192.168.203.32@tcp:502:llog_process_th.0 00000100:00100000:2.0:1782239828.971307:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5decbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afaefb1a-536b-42a3-a3ff-47200f8611c3+10:6103:x1868813737925120:12345-192.168.203.32@tcp:502:llog_process_th.0 Request processed in 603us (3051us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239828.971319:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 174 00000100:00100000:1.0:1782239828.978483:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239828.978592:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737925248 00000100:00100000:0.0:1782239828.978605:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737925248 00000100:00100000:0.0:1782239828.978679:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 175 00000100:00100000:0.0:1782239828.978691:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5decbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afaefb1a-536b-42a3-a3ff-47200f8611c3+10:6103:x1868813737925248:12345-192.168.203.32@tcp:502:llog_process_th.0 00000100:00100000:0.0:1782239828.979056:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5decbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afaefb1a-536b-42a3-a3ff-47200f8611c3+10:6103:x1868813737925248:12345-192.168.203.32@tcp:502:llog_process_th.0 Request processed in 366us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239828.979064:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 175 00010000:00010000:0.0:1782239829.215274:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1782239829.727520:0:5787:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1782239829.727528:0:5787:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9bb5eddbf000 from 4 10000000:01000000:2.0:1782239829.727532:0:5787:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1782239829.727580:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5ee29f600/0x8c5345f1c1ec4d04 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239829.727593:0:5787:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: ffff9bb5ee29f600/0x8c5345f1c1ec4d04 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239829.727604:0:5787:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff9bb5ee29f600/0x8c5345f1c1ec4d04 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239829.727630:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5dee24000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758924032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782239829.727705:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239829.727781:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c84b9300 going to sleep for 11 seconds 00000100:00100000:3.0:1782239829.727863:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758924032 00000100:00100000:3.0:1782239829.727870:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758924032 00000100:00100000:3.0:1782239829.727929:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1782239829.727939:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5decbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+16:5787:x1868813758924032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782239829.727953:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782239829.727966:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb5c2a45600/0x8c5345f1c1ec4d0b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c5345f1c1ec4d04 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239829.727989:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb5c2a45600/0x8c5345f1c1ec4d0b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4d04 expref: 17 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239829.728009:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb5c2a45600/0x8c5345f1c1ec4d0b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4d04 expref: 17 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239829.728025:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5c2a45600, rc 0) 00000100:00100000:3.0:1782239829.728067:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5decbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+17:5787:x1868813758924032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239829.728074:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1782239829.728119:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5dee24000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758924032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782239829.728133:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff9bb5ee29f600/0x8c5345f1c1ec4d04 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4d0b expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239829.728141:0:5787:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff9bb5ee29f600/0x8c5345f1c1ec4d04 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c5345f1c1ec4d0b expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239829.729309:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f780f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758924160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782239829.729401:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239829.729448:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5d1cd0d80 going to sleep for 11 seconds 00000100:00100000:2.0:1782239829.729548:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758924160 00000100:00100000:2.0:1782239829.729555:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758924160 00000100:00100000:2.0:1782239829.729598:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1782239829.729606:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5decbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+17:5787:x1868813758924160:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782239829.732176:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5decbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+17:5787:x1868813758924160:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2560us (2765us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239829.732191:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1782239829.732391:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f780f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758924160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782239829.732463:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f780f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758924288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782239829.732513:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239829.732555:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5d1cd0d80 going to sleep for 11 seconds 00000100:00100000:2.0:1782239829.732832:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758924288 00000100:00100000:2.0:1782239829.732839:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758924288 00000100:00100000:2.0:1782239829.732877:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1782239829.732885:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5decbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+17:5787:x1868813758924288:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782239829.733098:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5decbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+17:5787:x1868813758924288:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 213us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239829.733106:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1782239829.733149:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f780f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758924288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782239829.740368:0:8403:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f780fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:8403:1868813758924416:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782239829.740457:0:8403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239829.740499:0:8403:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c8460b40 going to sleep for 11 seconds 00000100:00100000:2.0:1782239829.740566:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758924416 00000100:00100000:2.0:1782239829.740573:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758924416 00000100:00100000:2.0:1782239829.740627:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1782239829.740634:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5decbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+17:8403:x1868813758924416:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782239829.740831:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5decbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+17:8403:x1868813758924416:12345-0@lo:502:llog_process_th.0 Request processed in 197us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239829.740836:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1782239829.741355:0:8403:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f780fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:8403:1868813758924416:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1782239829.741389:0:8403:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782239829.741400:0:8403:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782239829.741403:0:8403:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1782239829.741409:0:8403:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bb5eddbf000 00000020:00000080:1.0:1782239829.741417:0:8403:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1782239829.741529:0:8403:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f48ee300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:8403:1868813758924544:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782239829.741578:0:8403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239829.741606:0:8403:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5d1ff1f00 going to sleep for 11 seconds 00000100:00100000:3.0:1782239829.742573:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758924544 00000100:00100000:3.0:1782239829.742581:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758924544 00000100:00100000:3.0:1782239829.742639:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1782239829.742650:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5decbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+17:8403:x1868813758924544:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782239829.742889:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5decbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+17:8403:x1868813758924544:12345-0@lo:502:llog_process_th.0 Request processed in 240us (1308us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239829.742896:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1782239829.743036:0:8403:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f48ee300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:8403:1868813758924544:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1782239829.743065:0:8403:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782239829.743072:0:8403:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782239829.743074:0:8403:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1782239829.743078:0:8403:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1782239829.743404:0:5787:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1782239829.743511:0:5787:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1782239829.743522:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5ee29f600/0x8c5345f1c1ec4d04 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4d0b expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239829.743534:0:5787:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff9bb5ee29f600/0x8c5345f1c1ec4d04 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4d0b expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782239829.743545:0:5787:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1782239829.743548:0:5787:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9bb5c8863000 from 4 10000000:01000000:3.0:1782239829.743551:0:5787:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1782239829.743586:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a45e00/0x8c5345f1c1ec4d12 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239829.743596:0:5787:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a45e00/0x8c5345f1c1ec4d12 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239829.743605:0:5787:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a45e00/0x8c5345f1c1ec4d12 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239829.743627:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f780c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758924672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782239829.743672:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239829.743711:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5d1cab780 going to sleep for 11 seconds 00000100:00100000:1.0:1782239829.743795:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758924672 00000100:00100000:1.0:1782239829.743800:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758924672 00000100:00100000:1.0:1782239829.743833:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1782239829.743841:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5decbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+17:5787:x1868813758924672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782239829.743852:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782239829.743864:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb5c1677000/0x8c5345f1c1ec4d19 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c5345f1c1ec4d12 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239829.743887:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb5c1677000/0x8c5345f1c1ec4d19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4d12 expref: 18 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239829.743898:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb5c1677000/0x8c5345f1c1ec4d19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4d12 expref: 18 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239829.743906:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5c1677000, rc 0) 00000100:00100000:1.0:1782239829.743950:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5decbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+18:5787:x1868813758924672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239829.743956:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1782239829.744003:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f780c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758924672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782239829.744026:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a45e00/0x8c5345f1c1ec4d12 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4d19 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239829.744036:0:5787:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a45e00/0x8c5345f1c1ec4d12 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c5345f1c1ec4d19 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239829.744094:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f48ee300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758924800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782239829.744126:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239829.744320:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5e8d3f000 going to sleep for 11 seconds 00000100:00100000:1.0:1782239829.744336:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758924800 00000100:00100000:1.0:1782239829.744341:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758924800 00000100:00100000:1.0:1782239829.744368:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1782239829.744375:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5decbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+18:5787:x1868813758924800:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782239829.744694:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5decbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+18:5787:x1868813758924800:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 318us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239829.744702:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1782239829.744737:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f48ee300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758924800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782239829.744805:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f48ee300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758924928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782239829.744848:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239829.744872:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5e8d3f000 going to sleep for 11 seconds 00000100:00100000:1.0:1782239829.744886:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758924928 00000100:00100000:1.0:1782239829.744890:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758924928 00000100:00100000:1.0:1782239829.744911:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1782239829.744918:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5decbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+18:5787:x1868813758924928:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782239829.745083:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5decbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+18:5787:x1868813758924928:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 164us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239829.745101:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1782239829.745138:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f48ee300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758924928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782239829.746562:0:8408:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5dee25500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:8408:1868813758925056:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782239829.746627:0:8408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239829.746665:0:8408:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c84b9300 going to sleep for 11 seconds 00000100:00100000:1.0:1782239829.748334:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758925056 00000100:00100000:1.0:1782239829.748346:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758925056 00000100:00100000:1.0:1782239829.748399:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1782239829.748409:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d0330050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+18:8408:x1868813758925056:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782239829.748661:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d0330050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+18:8408:x1868813758925056:12345-0@lo:502:llog_process_th.0 Request processed in 252us (2033us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239829.748669:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1782239829.749019:0:8408:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5dee25500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:8408:1868813758925056:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1782239829.749053:0:8408:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782239829.749064:0:8408:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782239829.749066:0:8408:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1782239829.749073:0:8408:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bb5c8863000 00000020:00000080:2.0:1782239829.749075:0:8408:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1782239829.749168:0:8408:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5dee25500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:8408:1868813758925184:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782239829.749291:0:8408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239829.749319:0:8408:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5f25b0540 going to sleep for 11 seconds 00000100:00100000:1.0:1782239829.751914:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758925184 00000100:00100000:1.0:1782239829.751928:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758925184 00000100:00100000:1.0:1782239829.751983:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1782239829.752003:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d0330c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+18:8408:x1868813758925184:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782239829.753073:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d0330c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+18:8408:x1868813758925184:12345-0@lo:502:llog_process_th.0 Request processed in 1074us (3774us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239829.753085:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1782239829.757636:0:8408:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5dee25500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:8408:1868813758925184:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1782239829.759408:0:8408:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782239829.759432:0:8408:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782239829.759436:0:8408:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1782239829.759442:0:8408:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1782239829.760608:0:5787:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1782239829.760634:0:5787:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1782239829.760646:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a45e00/0x8c5345f1c1ec4d12 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4d19 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239829.760659:0:5787:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a45e00/0x8c5345f1c1ec4d12 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4d19 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782239829.760669:0:5787:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1782239829.760672:0:5787:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9bb5c8415000 from 4 10000000:01000000:0.0:1782239829.760675:0:5787:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1782239829.760709:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5c0030a00/0x8c5345f1c1ec4d20 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239829.760718:0:5787:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: ffff9bb5c0030a00/0x8c5345f1c1ec4d20 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239829.760729:0:5787:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff9bb5c0030a00/0x8c5345f1c1ec4d20 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782239829.760782:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5e8ec8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758925312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782239829.760858:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239829.760896:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5d0dde900 going to sleep for 11 seconds 00000100:00100000:0.0:1782239829.760923:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758925312 00000100:00100000:0.0:1782239829.760929:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758925312 00000100:00100000:0.0:1782239829.760977:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1782239829.760987:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d0330450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+18:5787:x1868813758925312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782239829.761010:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782239829.761026:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb5c0030800/0x8c5345f1c1ec4d27 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c5345f1c1ec4d20 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239829.761049:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb5c0030800/0x8c5345f1c1ec4d27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4d20 expref: 19 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239829.761059:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb5c0030800/0x8c5345f1c1ec4d27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4d20 expref: 19 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239829.761068:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5c0030800, rc 0) 00000100:00100000:0.0:1782239829.761103:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d0330450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:5787:x1868813758925312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239829.761109:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1782239829.761150:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5e8ec8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758925312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782239829.761162:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff9bb5c0030a00/0x8c5345f1c1ec4d20 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4d27 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239829.761172:0:5787:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff9bb5c0030a00/0x8c5345f1c1ec4d20 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c5345f1c1ec4d27 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782239829.761230:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5e8ec8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758925440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782239829.761250:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239829.761262:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5d0dde900 going to sleep for 11 seconds 00000100:00100000:0.0:1782239829.761278:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758925440 00000100:00100000:0.0:1782239829.761281:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758925440 00000100:00100000:0.0:1782239829.761302:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1782239829.761308:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d0333c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:5787:x1868813758925440:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782239829.761539:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d0333c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:5787:x1868813758925440:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 230us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239829.761552:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1782239829.761579:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5e8ec8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758925440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782239829.761601:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5e8ec8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758925568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782239829.761633:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239829.761644:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5d0dde900 going to sleep for 11 seconds 00000100:00100000:0.0:1782239829.761653:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758925568 00000100:00100000:0.0:1782239829.761656:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758925568 00000100:00100000:0.0:1782239829.761683:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1782239829.761690:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d0333850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:5787:x1868813758925568:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782239829.761854:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d0333850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:5787:x1868813758925568:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 165us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239829.761861:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1782239829.761893:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5e8ec8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758925568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782239829.762078:0:8411:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5e8ec8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:8411:1868813758925696:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782239829.762114:0:8411:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239829.762133:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758925696 00000100:00100000:0.0:1782239829.762137:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758925696 00000100:00100000:0.0:1782239829.762164:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1782239829.762171:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d0332050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:8411:x1868813758925696:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782239829.762285:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d0332050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:8411:x1868813758925696:12345-0@lo:502:llog_process_th.0 Request processed in 114us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239829.762292:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1782239829.762318:0:8411:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5d0dde780 going to sleep for 11 seconds 00000100:00100000:0.0:1782239829.762329:0:8411:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5e8ec8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:8411:1868813758925696:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1782239829.762358:0:8411:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782239829.762367:0:8411:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782239829.762370:0:8411:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1782239829.762377:0:8411:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bb5c8415000 00000020:00000080:0.0:1782239829.762379:0:8411:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1782239829.762454:0:8411:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5e8ec8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:8411:1868813758925824:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782239829.762486:0:8411:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239829.762504:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758925824 00000100:00100000:0.0:1782239829.762507:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758925824 00000100:00100000:0.0:1782239829.762530:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1782239829.762536:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d0333450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:8411:x1868813758925824:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782239829.762644:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d0333450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:8411:x1868813758925824:12345-0@lo:502:llog_process_th.0 Request processed in 108us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239829.762651:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1782239829.762680:0:8411:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5cfcec540 going to sleep for 11 seconds 00000100:00100000:0.0:1782239829.762692:0:8411:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5e8ec8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:8411:1868813758925824:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1782239829.762710:0:8411:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782239829.762714:0:8411:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782239829.762715:0:8411:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1782239829.762719:0:8411:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1782239829.762779:0:5787:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1782239829.762793:0:5787:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1782239829.762802:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5c0030a00/0x8c5345f1c1ec4d20 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4d27 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239829.762811:0:5787:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff9bb5c0030a00/0x8c5345f1c1ec4d20 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4d27 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239830.238954:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782239830.303122:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782239830.303144:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f48ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813758925952:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782239830.303223:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239830.303677:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758925952 00000100:00100000:1.0:1782239830.303685:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758925952 00000100:00100000:1.0:1782239830.303742:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1782239830.303769:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f780d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1868813758925952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782239830.303800:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782239830.303843:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f780d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1868813758925952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239830.303850:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1782239830.304000:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1782239830.304035:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb5f48ee300 x1868813758925952/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782239846 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782239830.304052:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f48ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813758925952:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1782239831.263202:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782239831.330654:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5dee24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1868813758926208:0@lo:400:kworker.0 00000100:00100000:2.0:1782239831.330723:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239831.330807:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5dee26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813758926720:0@lo:400:kworker.0 00000100:00100000:2.0:1782239831.330833:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239831.330862:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1782239831.330868:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5dee25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3305:1868813758926080:0@lo:400:kworker.0 00000100:00100000:2.0:1782239831.330895:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239831.330914:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5dee24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1868813758926592:0@lo:400:kworker.0 00000100:00100000:2.0:1782239831.330956:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239831.331011:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5dee24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1868813758926464:0@lo:400:kworker.0 00000100:00100000:2.0:1782239831.331042:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239831.331057:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782239831.331063:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5dee26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1868813758926336:0@lo:400:kworker.0 00000100:00100000:2.0:1782239831.331084:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239831.331114:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758926208 00000100:00100000:2.0:1782239831.331121:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758926208 00000100:00100000:2.0:1782239831.331163:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758926592 00000100:00100000:2.0:1782239831.331166:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758926592 00000100:00100000:2.0:1782239831.331187:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758926336 00000100:00100000:2.0:1782239831.331189:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758926336 00000100:00100000:2.0:1782239831.331209:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1782239831.331216:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5dee25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1868813758926208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782239831.331268:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5dee25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1868813758926208:12345-0@lo:400:kworker.0 Request processed in 52us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239831.331276:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1782239831.331293:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1782239831.331299:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f46fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1868813758926592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782239831.331326:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f46fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1868813758926592:12345-0@lo:400:kworker.0 Request processed in 27us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239831.331331:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1782239831.331343:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1782239831.331349:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f46ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1868813758926336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782239831.331379:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f46ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1868813758926336:12345-0@lo:400:kworker.0 Request processed in 31us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239831.331384:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:2.0:1782239831.331406:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782239831.331430:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5dee26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1868813758926336:0@lo:400:kworker.0 00000100:00100000:2.0:1782239831.331464:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5dee24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1868813758926592:0@lo:400:kworker.0 00000100:00100000:2.0:1782239831.331472:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5dee24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1868813758926208:0@lo:400:kworker.0 00000100:00100000:1.0:1782239831.331586:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758926720 00000100:00100000:1.0:1782239831.331597:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758926720 00000100:00100000:1.0:1782239831.331637:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758926464 00000100:00100000:1.0:1782239831.331640:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758926464 00000100:00100000:1.0:1782239831.331659:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1782239831.331665:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5dee26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1868813758926720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782239831.331704:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5dee26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1868813758926720:12345-0@lo:400:kworker.0 Request processed in 39us (869us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239831.331710:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1782239831.331721:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1782239831.331728:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f46fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1868813758926464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782239831.331780:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f46fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1868813758926464:12345-0@lo:400:kworker.0 Request processed in 53us (737us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239831.331786:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1782239831.331875:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758926080 00000100:00100000:0.0:1782239831.331880:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758926080 00000100:00100000:0.0:1782239831.331915:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1782239831.331922:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d0332450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:3305:x1868813758926080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782239831.331956:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d0332450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:3305:x1868813758926080:12345-0@lo:400:kworker.0 Request processed in 35us (1060us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239831.331962:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00080000:2.0:1782239831.335239:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1782239831.335305:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb5dee24380 x1868813758926464/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782239847 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782239831.335322:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5dee24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1868813758926464:0@lo:400:kworker.0 00000100:00100000:2.0:1782239831.335378:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5dee25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3305:1868813758926080:0@lo:400:kworker.0 00010000:00080000:2.0:1782239831.335392:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb5dee26d80 x1868813758926720/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782239847 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782239831.335402:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5dee26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813758926720:0@lo:400:kworker.0 00000100:00100000:2.0:1782239831.839231:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f780ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813758926848:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782239831.839304:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239831.839464:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758926848 00000100:00100000:1.0:1782239831.839476:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758926848 00000100:00100000:1.0:1782239831.839545:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1782239831.839557:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f46fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1868813758926848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782239831.839612:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782239831.839711:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f46fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1868813758926848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 156us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239831.839720:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1782239831.839888:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb5f780ed80 x1868813758926848/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782239847 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782239831.839911:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f780ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813758926848:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782239832.289881:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782239833.109836:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239833.109866:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239833.109895:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239833.109926:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239833.109955:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737925760 00000100:00100000:1.0:1782239833.109990:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737925760 00000100:00100000:1.0:1782239833.110044:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737925632 00000100:00100000:1.0:1782239833.110048:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737925632 00000100:00100000:1.0:1782239833.110070:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 19 00000100:00100000:1.0:1782239833.110080:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+5:2344:x1868813737925760:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:1.0:1782239833.110151:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+5:2344:x1868813737925760:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 73us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239833.110159:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 19 00000100:00100000:1.0:1782239833.110176:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 20 00000100:00100000:1.0:1782239833.110182:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+5:2344:x1868813737925632:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:2.0:1782239833.111908:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737925504 00000100:00100000:2.0:1782239833.111921:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737925504 00000100:00100000:2.0:1782239833.111998:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 35 00000100:00100000:2.0:1782239833.112015:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+6:2344:x1868813737925504:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:1.0:1782239833.112051:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+5:2344:x1868813737925632:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 27us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239833.112060:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 20 00000100:00100000:2.0:1782239833.112077:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+6:2344:x1868813737925504:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 72us (2253us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239833.112084:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 35 00000100:00080000:2.0:1782239833.112112:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782239833.112117:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782239833.112119:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782239833.112153:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737925376 00000100:00100000:2.0:1782239833.112157:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737925376 00000100:00100000:2.0:1782239833.112185:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 192 00000100:00100000:2.0:1782239833.112192:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5c886b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afaefb1a-536b-42a3-a3ff-47200f8611c3+10:2344:x1868813737925376:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:2.0:1782239833.112237:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5c886b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afaefb1a-536b-42a3-a3ff-47200f8611c3+10:2344:x1868813737925376:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 44us (2340us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239833.112244:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 192 00010000:00010000:1.0:1782239833.314159:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782239834.337612:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1782239835.321187:0:8657:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg332-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:1.0:1782239835.363090:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782239835.423890:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782239835.423913:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5e8ec8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813758926976:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782239835.423991:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239835.424060:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758926976 00000100:00100000:0.0:1782239835.424068:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758926976 00000100:00080000:2.0:1782239835.424140:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782239835.424211:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1782239835.424223:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8ecad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1868813758926976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782239835.424265:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782239835.424306:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8ecad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1868813758926976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239835.424314:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:0.0:1782239835.424349:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb5e8ec8380 x1868813758926976/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782239851 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782239835.424365:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5e8ec8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813758926976:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1782239836.382939:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782239836.448097:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5e8ec8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3304:1868813758927104:0@lo:400:kworker.0 00000100:00100000:0.0:1782239836.448166:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239836.448212:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5e8eee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1868813758927616:0@lo:400:kworker.0 00000100:00100000:0.0:1782239836.448236:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239836.448274:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1782239836.448280:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5e8ec8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1868813758927232:0@lo:400:kworker.0 00000100:00100000:0.0:1782239836.448302:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239836.448319:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5e8eedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1868813758927744:0@lo:400:kworker.0 00000100:00100000:0.0:1782239836.448340:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239836.448368:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5e8ecb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1868813758927360:0@lo:400:kworker.0 00000100:00100000:0.0:1782239836.448390:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239836.448407:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782239836.448412:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5e8ec9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813758927488:0@lo:400:kworker.0 00000100:00100000:0.0:1782239836.448431:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239836.448460:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758927104 00000100:00100000:0.0:1782239836.448467:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758927104 00000100:00100000:0.0:1782239836.448514:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1782239836.448521:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5c886a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:3304:x1868813758927104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782239836.448569:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5c886a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:3304:x1868813758927104:12345-0@lo:400:kworker.0 Request processed in 48us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239836.448576:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1782239836.448607:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758927616 00000100:00100000:0.0:1782239836.448611:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758927616 00000100:00100000:0.0:1782239836.448640:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758927232 00000100:00100000:0.0:1782239836.448643:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758927232 00000100:00100000:0.0:1782239836.448667:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758927360 00000100:00100000:0.0:1782239836.448670:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758927360 00000100:00100000:0.0:1782239836.448700:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1782239836.448707:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8eef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1868813758927616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782239836.448739:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8eef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1868813758927616:12345-0@lo:400:kworker.0 Request processed in 34us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239836.448768:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1782239836.448782:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1782239836.448788:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8eec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1868813758927232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782239836.448816:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8eec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1868813758927232:12345-0@lo:400:kworker.0 Request processed in 28us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239836.448822:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1782239836.448834:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1782239836.448840:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8eeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1868813758927360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782239836.448869:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8eeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1868813758927360:12345-0@lo:400:kworker.0 Request processed in 30us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239836.448875:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1782239836.448897:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758927744 00000100:00100000:0.0:1782239836.448900:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758927744 00000100:00100000:0.0:1782239836.448924:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758927488 00000100:00100000:0.0:1782239836.448927:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758927488 00000100:00100000:0.0:1782239836.448953:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1782239836.448959:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8eed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1868813758927744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782239836.448988:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8eed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1868813758927744:12345-0@lo:400:kworker.0 Request processed in 29us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239836.448994:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1782239836.449005:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1782239836.449019:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8eedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1868813758927488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782239836.449046:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8eedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1868813758927488:12345-0@lo:400:kworker.0 Request processed in 30us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239836.449052:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:0.0:1782239836.449076:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782239836.449081:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1782239836.449116:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb5e8ec9c00 x1868813758927488/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782239852 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782239836.449130:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5e8ec9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813758927488:0@lo:400:kworker.0 00000100:00100000:0.0:1782239836.449140:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5e8ecb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1868813758927360:0@lo:400:kworker.0 00000100:00100000:0.0:1782239836.449169:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5e8ec8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1868813758927232:0@lo:400:kworker.0 00010000:00080000:0.0:1782239836.449178:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb5e8eedc00 x1868813758927744/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782239852 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782239836.449185:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5e8eedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1868813758927744:0@lo:400:kworker.0 00000100:00100000:0.0:1782239836.449193:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5e8ec8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3304:1868813758927104:0@lo:400:kworker.0 00000100:00100000:0.0:1782239836.449201:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5e8eee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1868813758927616:0@lo:400:kworker.0 00000100:00100000:2.0:1782239836.960770:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f46fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813758927872:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782239836.960834:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239836.960906:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758927872 00000100:00100000:2.0:1782239836.960913:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758927872 00000100:00100000:2.0:1782239836.960972:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1782239836.960981:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f46fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1868813758927872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782239836.961017:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782239836.961060:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f46fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1868813758927872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239836.961068:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1782239836.963393:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb5f46fd180 x1868813758927872/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782239852 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782239836.963417:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f46fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813758927872:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782239837.407058:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782239838.237862:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239838.237910:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239838.237962:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737926016 00000100:00100000:0.0:1782239838.237974:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737926016 00000100:00100000:0.0:1782239838.238069:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 39 00000100:00100000:0.0:1782239838.238083:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8eee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+6:2345:x1868813737926016:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:0.0:1782239838.238184:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8eee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+6:2345:x1868813737926016:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 104us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239838.238192:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 39 00000100:00080000:0.0:1782239838.238231:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782239838.240431:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737925888 00000100:00100000:3.0:1782239838.240449:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737925888 00000100:00100000:3.0:1782239838.240558:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 194 00000100:00100000:3.0:1782239838.240569:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5c8869850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afaefb1a-536b-42a3-a3ff-47200f8611c3+10:2345:x1868813737925888:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:3.0:1782239838.240663:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5c8869850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afaefb1a-536b-42a3-a3ff-47200f8611c3+10:2345:x1868813737925888:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 96us (2815us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239838.240672:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 194 00000100:00100000:0.0:1782239838.247114:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239838.247151:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239838.247470:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737926144 00000100:00100000:1.0:1782239838.247483:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737926144 00000100:00100000:1.0:1782239838.247576:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737926272 00000100:00100000:1.0:1782239838.247579:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737926272 00000100:00100000:1.0:1782239838.247607:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 10 00000100:00100000:1.0:1782239838.247618:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8eedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+5:2343:x1868813737926144:12345-192.168.203.32@tcp:9:kworker.0 00000020:00000080:1.0:1782239838.247672:0:6588:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8c5345f1c1ec4c63 00000100:00080000:1.0:1782239838.247684:0:6588:0:(import.c:65:import_set_state_nolock()) ffff9bb5f460e000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1782239838.247726:0:6588:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1782239838.248177:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8eedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+2:2343:x1868813737926144:12345-192.168.203.32@tcp:9:kworker.0 Request processed in 559us (1077us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239838.248216:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 10 00000100:00100000:1.0:1782239838.248235:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 11 00000100:00100000:1.0:1782239838.248249:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8eed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+5:2343:x1868813737926272:12345-192.168.203.32@tcp:9:kworker.0 00000020:00000080:1.0:1782239838.248265:0:6588:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8c5345f1c1ec4c6a 00000100:00080000:1.0:1782239838.248271:0:6588:0:(import.c:65:import_set_state_nolock()) ffff9bb5f460f000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1782239838.248297:0:6588:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:0.0:1782239838.248866:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1782239838.248877:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782239838.248882:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1782239838.252040:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782239838.253291:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8eed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+2:2343:x1868813737926272:12345-192.168.203.32@tcp:9:kworker.0 Request processed in 5034us (6123us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239838.253316:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 11 00010000:00010000:1.0:1782239838.437112:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1782239839.086503:0:6614:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 36dd742b-25b8-431e-bf41-75f2fff47ffb 00000020:00000080:0.0:1782239839.086512:0:6614:0:(genops.c:906:class_export_put()) final put ffff9bb5f4999000/36dd742b-25b8-431e-bf41-75f2fff47ffb 00000020:00000080:2.0:1782239839.086603:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9bb5f4999000/36dd742b-25b8-431e-bf41-75f2fff47ffb for lustre-OST0000 00000020:00000080:2.0:1782239839.086987:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9bb5f460e000 for lustre-OST0000 00010000:00010000:1.0:1782239839.455164:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782239840.482681:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782239840.544048:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5e8eef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1868813758928000:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782239840.544153:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239840.544260:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758928000 00000100:00100000:0.0:1782239840.544271:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758928000 00000100:00100000:0.0:1782239840.544348:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1782239840.544359:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8eeea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1868813758928000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782239840.544404:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782239840.544456:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8eeea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1868813758928000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239840.544464:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:0.0:1782239840.544488:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1782239840.544537:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb5e8eef480 x1868813758928000/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782239856 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782239840.544570:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5e8eef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1868813758928000:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1782239841.516026:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782239841.569546:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f48edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1868813758928384:0@lo:400:kworker.0 00000100:00100000:1.0:1782239841.569637:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239841.569709:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782239841.569716:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f48ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813758928512:0@lo:400:kworker.0 00000100:00100000:1.0:1782239841.569744:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239841.569819:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758928384 00000100:00100000:1.0:1782239841.569828:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758928384 00000100:00100000:1.0:1782239841.569893:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1782239841.569914:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1868813758928384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782239841.569976:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1868813758928384:12345-0@lo:400:kworker.0 Request processed in 73us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239841.569984:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1782239841.570011:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758928512 00000100:00100000:1.0:1782239841.570014:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758928512 00000100:00100000:1.0:1782239841.570041:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1782239841.570057:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1868813758928512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782239841.570089:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1868813758928512:12345-0@lo:400:kworker.0 Request processed in 33us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239841.570095:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:1.0:1782239841.570113:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1782239841.570226:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb5f48ef800 x1868813758928512/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782239857 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782239841.570243:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f48ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813758928512:0@lo:400:kworker.0 00000100:00100000:1.0:1782239841.570255:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f48edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1868813758928384:0@lo:400:kworker.0 00000100:00100000:0.0:1782239841.571679:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f48ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3304:1868813758928128:0@lo:400:kworker.0 00000100:00100000:0.0:1782239841.571780:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239841.571825:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f48ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1868813758928640:0@lo:400:kworker.0 00000100:00100000:0.0:1782239841.571855:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239841.571880:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1782239841.571887:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f48ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1868813758928256:0@lo:400:kworker.0 00000100:00100000:0.0:1782239841.571918:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239841.571936:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f48ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1868813758928768:0@lo:400:kworker.0 00000100:00100000:0.0:1782239841.571960:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239841.571993:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758928128 00000100:00100000:0.0:1782239841.571999:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758928128 00000100:00100000:0.0:1782239841.572043:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1782239841.572051:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5c886a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:3304:x1868813758928128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782239841.572102:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5c886a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:3304:x1868813758928128:12345-0@lo:400:kworker.0 Request processed in 52us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239841.572109:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1782239841.572145:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758928640 00000100:00100000:0.0:1782239841.572149:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758928640 00000100:00100000:0.0:1782239841.572178:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758928256 00000100:00100000:0.0:1782239841.572181:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758928256 00000100:00100000:0.0:1782239841.572199:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1782239841.572206:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8eef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1868813758928640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782239841.572238:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8eef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1868813758928640:12345-0@lo:400:kworker.0 Request processed in 33us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239841.572253:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1782239841.572266:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1782239841.572272:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8eec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1868813758928256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782239841.572313:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8eec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1868813758928256:12345-0@lo:400:kworker.0 Request processed in 41us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239841.572319:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1782239841.572546:0:8312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758928768 00000100:00100000:3.0:1782239841.572551:0:8312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758928768 00000100:00100000:3.0:1782239841.572695:0:8312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1782239841.572706:0:8312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8eeca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1868813758928768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782239841.572768:0:8312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8eeca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1868813758928768:12345-0@lo:400:kworker.0 Request processed in 46us (786us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239841.572775:0:8312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1782239841.572934:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f48ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1868813758928256:0@lo:400:kworker.0 00010000:00080000:0.0:1782239841.572954:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb5f48ed180 x1868813758928768/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782239857 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782239841.572967:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f48ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1868813758928768:0@lo:400:kworker.0 00000100:00100000:0.0:1782239841.572977:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f48ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3304:1868813758928128:0@lo:400:kworker.0 00000100:00100000:0.0:1782239841.572987:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f48ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1868813758928640:0@lo:400:kworker.0 00000100:00080000:1.0:1782239841.574422:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782239841.574432:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782239842.085910:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f46fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813758928896:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782239842.086015:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239842.086111:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758928896 00000100:00100000:2.0:1782239842.087957:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758928896 00000100:00100000:2.0:1782239842.088064:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1782239842.088077:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f46fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1868813758928896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782239842.092010:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782239842.092160:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f46fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1868813758928896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4080us (6140us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239842.092173:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1782239842.092775:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb5f46fdf80 x1868813758928896/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782239858 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782239842.092802:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f46fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813758928896:0@lo:13:osp-pre-1-0.0 00000001:00100000:3.0:1782239842.200095:0:7493:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 36dd742b-25b8-431e-bf41-75f2fff47ffb 00000020:00000080:3.0:1782239842.200105:0:7493:0:(genops.c:906:class_export_put()) final put ffff9bb5f4609800/36dd742b-25b8-431e-bf41-75f2fff47ffb 00000020:00000080:1.0:1782239842.200236:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9bb5f4609800/36dd742b-25b8-431e-bf41-75f2fff47ffb for lustre-OST0001 00000020:00000080:1.0:1782239842.200304:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9bb5f460f000 for lustre-OST0001 00010000:00010000:0.0:1782239842.529398:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782239842.895728:0:8903:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg332-server.virtnet: executing yml_node 00000100:00100000:3.0:1782239843.364383:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239843.364422:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239843.364450:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737926528 00000100:00100000:3.0:1782239843.364459:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737926528 00000100:00100000:3.0:1782239843.364519:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 43 00000100:00100000:3.0:1782239843.364531:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f780df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+6:2344:x1868813737926528:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:3.0:1782239843.364601:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f780df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+6:2344:x1868813737926528:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 73us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239843.364608:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 43 00000100:00100000:3.0:1782239843.364637:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737926400 00000100:00100000:3.0:1782239843.364641:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737926400 00000100:00100000:3.0:1782239843.366316:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 196 00000100:00100000:3.0:1782239843.366326:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5c8868850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afaefb1a-536b-42a3-a3ff-47200f8611c3+10:2344:x1868813737926400:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:3.0:1782239843.366381:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5c8868850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afaefb1a-536b-42a3-a3ff-47200f8611c3+10:2344:x1868813737926400:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 57us (1958us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239843.366389:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 196 00000100:00080000:3.0:1782239843.366422:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1782239843.551971:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782239844.574969:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782239845.600203:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782239845.663054:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782239845.663080:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5e8eec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813758929024:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782239845.663188:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239845.663420:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758929024 00000100:00100000:3.0:1782239845.663442:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758929024 00000100:00100000:3.0:1782239845.663510:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1782239845.663523:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1868813758929024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782239845.663562:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782239845.663608:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1868813758929024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239845.663615:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:0.0:1782239845.663776:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1782239845.664007:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb5e8eec700 x1868813758929024/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782239861 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782239845.664027:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5e8eec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813758929024:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1782239846.628273:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782239846.686936:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f48ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3304:1868813758929152:0@lo:400:kworker.0 00000100:00100000:1.0:1782239846.686994:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f48ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1868813758929280:0@lo:400:kworker.0 00000100:00100000:0.0:1782239846.687017:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239846.687047:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239846.687075:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f48ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1868813758929664:0@lo:400:kworker.0 00000100:00100000:1.0:1782239846.687090:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f48ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813758929792:0@lo:400:kworker.0 00000100:00100000:0.0:1782239846.687105:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239846.687126:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239846.687161:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758929280 00000100:00100000:1.0:1782239846.687166:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758929664 00000100:00100000:0.0:1782239846.687169:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758929280 00000100:00100000:1.0:1782239846.687172:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758929664 00000100:00100000:1.0:1782239846.687222:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1782239846.687232:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8eee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1868813758929664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782239846.687263:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758929152 00000100:00100000:3.0:1782239846.687269:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758929152 00000100:00100000:1.0:1782239846.687290:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8eee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1868813758929664:12345-0@lo:400:kworker.0 Request processed in 58us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239846.687299:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1782239846.687314:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1782239846.687321:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1782239846.687326:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5c886ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:3304:x1868813758929152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782239846.687333:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1868813758929280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782239846.687374:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1868813758929280:12345-0@lo:400:kworker.0 Request processed in 44us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239846.687382:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1782239846.687387:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5c886ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:3304:x1868813758929152:12345-0@lo:400:kworker.0 Request processed in 62us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239846.687397:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1782239846.688057:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f48ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1868813758929536:0@lo:400:kworker.0 00000100:00100000:0.0:1782239846.688170:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239846.688269:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782239846.688276:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f48ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1868813758929408:0@lo:400:kworker.0 00000100:00100000:0.0:1782239846.688300:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239846.688324:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758929408 00000100:00100000:0.0:1782239846.688327:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758929408 00000100:00100000:0.0:1782239846.688356:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1782239846.688363:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8eece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1868813758929408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782239846.688406:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8eece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1868813758929408:12345-0@lo:400:kworker.0 Request processed in 43us (104us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239846.688413:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1782239846.688453:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f48ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1868813758929408:0@lo:400:kworker.0 00000100:00100000:3.0:1782239846.688474:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758929792 00000100:00100000:3.0:1782239846.688479:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758929792 00000100:00100000:3.0:1782239846.688508:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758929536 00000100:00100000:3.0:1782239846.688512:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758929536 00000100:00100000:3.0:1782239846.688547:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1782239846.688557:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1868813758929792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782239846.688569:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f48ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1868813758929280:0@lo:400:kworker.0 00000100:00100000:0.0:1782239846.688603:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1782239846.688609:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1868813758929792:12345-0@lo:400:kworker.0 Request processed in 53us (1482us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239846.688615:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8eed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1868813758929536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782239846.688620:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:3.0:1782239846.688653:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782239846.688658:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8eed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1868813758929536:12345-0@lo:400:kworker.0 Request processed in 46us (487us total) trans 0 rc 0/0 00000100:00080000:3.0:1782239846.688659:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782239846.688667:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1782239846.688687:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f48ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1868813758929664:0@lo:400:kworker.0 00000100:00100000:3.0:1782239846.688706:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f48ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3304:1868813758929152:0@lo:400:kworker.0 00010000:00080000:0.0:1782239846.688706:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb5f48ec000 x1868813758929536/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782239862 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782239846.688722:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f48ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1868813758929536:0@lo:400:kworker.0 00010000:00080000:0.0:1782239846.688767:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb5f48ed180 x1868813758929792/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782239862 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782239846.688777:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f48ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813758929792:0@lo:400:kworker.0 00000100:00100000:3.0:1782239847.199994:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782239847.200019:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f46ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1868813758929920:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782239847.200086:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239847.200300:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758929920 00000100:00100000:2.0:1782239847.200308:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758929920 00000100:00100000:2.0:1782239847.200364:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1782239847.200374:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f780d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1868813758929920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782239847.200410:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782239847.200474:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f780d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1868813758929920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239847.200481:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:3.0:1782239847.200578:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb5f46ff480 x1868813758929920/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782239863 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782239847.200596:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f46ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1868813758929920:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782239847.647003:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782239848.468972:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239848.469054:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239848.469207:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737926656 00000100:00100000:0.0:1782239848.469220:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737926656 00000100:00100000:0.0:1782239848.469289:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 198 00000100:00100000:0.0:1782239848.469302:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5c8869050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afaefb1a-536b-42a3-a3ff-47200f8611c3+10:2345:x1868813737926656:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:0.0:1782239848.469403:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5c8869050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afaefb1a-536b-42a3-a3ff-47200f8611c3+10:2345:x1868813737926656:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 103us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239848.469411:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 198 00000100:00100000:1.0:1782239848.473928:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737926784 00000100:00100000:1.0:1782239848.473945:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737926784 00000100:00100000:1.0:1782239848.474034:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 47 00000100:00100000:1.0:1782239848.474046:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f780f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+6:2344:x1868813737926784:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:1.0:1782239848.474165:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f780f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+6:2344:x1868813737926784:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 121us (5110us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239848.474173:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 47 00000100:00080000:3.0:1782239848.475120:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1782239848.671519:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782239849.126680:0:9096:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.54.83 00010000:00010000:1.0:1782239849.705525:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782239850.721102:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782239850.784453:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782239850.784486:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5e8eefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813758930048:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782239850.784582:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239850.784778:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758930048 00000100:00100000:2.0:1782239850.784790:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758930048 00000100:00100000:2.0:1782239850.784879:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1782239850.784894:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1868813758930048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782239850.784943:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782239850.785029:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1868813758930048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 140us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239850.785039:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1782239850.785209:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb5e8eefb80 x1868813758930048/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782239866 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782239850.785234:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5e8eefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813758930048:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1782239850.785315:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1782239851.748530:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782239851.810992:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f48ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1868813758930304:0@lo:400:kworker.0 00000100:00100000:3.0:1782239851.811233:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f48ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3304:1868813758930176:0@lo:400:kworker.0 00000100:00100000:3.0:1782239851.811283:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239851.811338:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f48ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1868813758930688:0@lo:400:kworker.0 00000100:00100000:3.0:1782239851.811380:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f48ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1868813758930432:0@lo:400:kworker.0 00000100:00100000:3.0:1782239851.811412:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f48ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1868813758930560:0@lo:400:kworker.0 00000100:00100000:3.0:1782239851.811442:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239851.811491:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758930176 00000100:00100000:3.0:1782239851.811500:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758930176 00000100:00100000:3.0:1782239851.811564:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1782239851.811575:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5c8869450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:3304:x1868813758930176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782239851.811640:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5c8869450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:3304:x1868813758930176:12345-0@lo:400:kworker.0 Request processed in 67us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239851.811649:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1782239851.811692:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758930560 00000100:00100000:3.0:1782239851.811696:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758930560 00000100:00100000:3.0:1782239851.811726:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1782239851.811733:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f780ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1868813758930560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782239851.811795:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f780ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1868813758930560:12345-0@lo:400:kworker.0 Request processed in 63us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239851.811801:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1782239851.811858:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb5f48ed880 x1868813758930560/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782239867 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782239851.811874:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f48ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1868813758930560:0@lo:400:kworker.0 00000100:00100000:1.0:1782239851.812254:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239851.812347:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb601359c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813758930816:0@lo:400:kworker.0 00000100:00100000:1.0:1782239851.812384:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239851.812739:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239851.821447:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f48ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3304:1868813758930176:0@lo:400:kworker.0 00000100:00100000:2.0:1782239851.822645:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239851.828066:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758930304 00000100:00100000:3.0:1782239851.828088:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758930304 00000100:00100000:3.0:1782239851.828186:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758930688 00000100:00100000:3.0:1782239851.828276:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758930688 00000100:00100000:3.0:1782239851.828322:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1782239851.828334:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7ce3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1868813758930304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782239851.828471:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7ce3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1868813758930304:12345-0@lo:400:kworker.0 Request processed in 139us (16216us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239851.828480:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1782239851.828500:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1782239851.828507:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f46fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1868813758930688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782239851.828546:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f46fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1868813758930688:12345-0@lo:400:kworker.0 Request processed in 39us (15807us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239851.828553:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1782239851.828579:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758930816 00000100:00100000:3.0:1782239851.828583:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758930816 00000100:00100000:3.0:1782239851.828613:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1782239851.828620:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7ce2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1868813758930816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782239851.828654:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7ce2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1868813758930816:12345-0@lo:400:kworker.0 Request processed in 35us (16269us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239851.828661:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1782239851.828808:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f48ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1868813758930688:0@lo:400:kworker.0 00000100:00080000:0.0:1782239851.829709:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782239851.829717:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782239851.829891:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f48ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1868813758930304:0@lo:400:kworker.0 00010000:00080000:1.0:1782239851.829910:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb601359c00 x1868813758930816/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782239867 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782239851.829922:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb601359c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813758930816:0@lo:400:kworker.0 00000100:00100000:3.0:1782239851.830731:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758930432 00000100:00100000:3.0:1782239851.830741:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758930432 00000100:00100000:3.0:1782239851.830851:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1782239851.830860:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f46fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1868813758930432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782239851.830945:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f46fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1868813758930432:12345-0@lo:400:kworker.0 Request processed in 86us (8306us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239851.830951:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1782239851.832402:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f48ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1868813758930432:0@lo:400:kworker.0 00000100:00080000:0.0:1782239851.832546:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782239852.321521:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782239852.321572:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f46fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1868813758930944:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782239852.321695:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239852.321805:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758930944 00000100:00100000:3.0:1782239852.321815:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758930944 00000100:00100000:3.0:1782239852.321901:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1782239852.321913:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f780ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1868813758930944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782239852.321964:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782239852.322021:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f780ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1868813758930944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239852.322029:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:3.0:1782239852.322078:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb5f46fca80 x1868813758930944/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782239868 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782239852.322120:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f46fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1868813758930944:0@lo:13:osp-pre-1-0.0 00000001:02000400:3.0:1782239852.423666:0:9193:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.54.83 00010000:00010000:3.0:1782239852.775445:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782239853.587904:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239853.588169:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239853.590346:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737927040 00000100:00100000:2.0:1782239853.590368:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737927040 00000100:00100000:2.0:1782239853.590486:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 51 00000100:00100000:2.0:1782239853.590503:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f780c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+6:2344:x1868813737927040:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:2.0:1782239853.590635:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f780c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+6:2344:x1868813737927040:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 137us (2746us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239853.590644:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 51 00000100:00080000:3.0:1782239853.591836:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782239853.599681:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737926912 00000100:00100000:0.0:1782239853.599703:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737926912 00000100:00100000:3.0:1782239853.599930:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 200 00000100:00100000:3.0:1782239853.599944:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8d76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afaefb1a-536b-42a3-a3ff-47200f8611c3+10:2344:x1868813737926912:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:3.0:1782239853.600068:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8d76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afaefb1a-536b-42a3-a3ff-47200f8611c3+10:2344:x1868813737926912:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 126us (12098us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239853.600077:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 200 00010000:00010000:1.0:1782239853.792149:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782239854.815170:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782239855.839201:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782239855.904669:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782239855.904699:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5e8eef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813758931072:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782239855.904836:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239855.905185:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758931072 00000100:00100000:0.0:1782239855.905196:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758931072 00000100:00100000:0.0:1782239855.905279:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1782239855.905292:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f46fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1868813758931072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782239855.905342:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782239855.905397:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f46fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1868813758931072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239855.905405:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:3.0:1782239855.906470:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1782239855.906892:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb5e8eef100 x1868813758931072/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782239871 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782239855.906923:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5e8eef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813758931072:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1782239856.537714:0:9291:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.54.83 00010000:00010000:3.0:1782239856.863906:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782239856.928892:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f780ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1868813758931584:0@lo:400:kworker.0 00000100:00100000:3.0:1782239856.929015:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239856.929096:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782239856.929103:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f780c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1868813758931456:0@lo:400:kworker.0 00000100:00100000:3.0:1782239856.929132:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239856.929168:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758931584 00000100:00100000:3.0:1782239856.929177:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758931584 00000100:00100000:3.0:1782239856.929238:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1782239856.929248:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1868813758931584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782239856.929310:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1868813758931584:12345-0@lo:400:kworker.0 Request processed in 63us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239856.929318:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1782239856.929345:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758931456 00000100:00100000:3.0:1782239856.929349:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758931456 00000100:00100000:3.0:1782239856.929384:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1782239856.929391:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1868813758931456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782239856.929422:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1868813758931456:12345-0@lo:400:kworker.0 Request processed in 32us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239856.929428:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:3.0:1782239856.929450:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782239856.929827:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f780f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1868813758931328:0@lo:400:kworker.0 00000100:00100000:1.0:1782239856.929866:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239856.929893:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f780e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813758931840:0@lo:400:kworker.0 00000100:00100000:1.0:1782239856.929916:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239856.929956:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1782239856.929964:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f780fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3305:1868813758931200:0@lo:400:kworker.0 00000100:00100000:1.0:1782239856.929996:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239856.930020:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f780c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1868813758931712:0@lo:400:kworker.0 00000100:00100000:1.0:1782239856.930042:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239856.930073:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758931328 00000100:00100000:1.0:1782239856.930077:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758931328 00000100:00100000:1.0:1782239856.930108:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758931712 00000100:00100000:1.0:1782239856.930111:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758931712 00000100:00100000:1.0:1782239856.930135:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1782239856.930140:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7ce1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1868813758931328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782239856.930196:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7ce1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1868813758931328:12345-0@lo:400:kworker.0 Request processed in 55us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239856.930203:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1782239856.930218:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1782239856.930224:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7ce0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1868813758931712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782239856.930250:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7ce0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1868813758931712:12345-0@lo:400:kworker.0 Request processed in 26us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239856.930255:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1782239856.930274:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758931200 00000100:00100000:1.0:1782239856.930278:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758931200 00000100:00100000:1.0:1782239856.930305:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1782239856.930311:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8d75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:3305:x1868813758931200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782239856.930341:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8d75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:3305:x1868813758931200:12345-0@lo:400:kworker.0 Request processed in 29us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239856.930347:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00080000:1.0:1782239856.930379:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782239856.930400:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f780fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3305:1868813758931200:0@lo:400:kworker.0 00000100:00100000:1.0:1782239856.930412:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f780c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1868813758931712:0@lo:400:kworker.0 00000100:00100000:1.0:1782239856.930421:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f780f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1868813758931328:0@lo:400:kworker.0 00000100:00100000:2.0:1782239856.930720:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758931840 00000100:00100000:2.0:1782239856.930725:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758931840 00000100:00100000:2.0:1782239856.930828:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1782239856.930840:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7ce3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1868813758931840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782239856.930886:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7ce3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1868813758931840:12345-0@lo:400:kworker.0 Request processed in 51us (968us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239856.930893:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1782239856.931379:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f780c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1868813758931456:0@lo:400:kworker.0 00010000:00080000:2.0:1782239856.932789:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb5f780ca80 x1868813758931584/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782239872 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782239856.932820:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f780ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1868813758931584:0@lo:400:kworker.0 00000100:00080000:1.0:1782239856.933053:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1782239856.933092:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb5f780e300 x1868813758931840/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782239872 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782239856.933104:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f780e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813758931840:0@lo:400:kworker.0 00000100:00100000:0.0:1782239857.439148:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f46fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813758931968:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782239857.439436:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239857.439632:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758931968 00000100:00100000:2.0:1782239857.439644:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758931968 00000100:00100000:2.0:1782239857.439740:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1782239857.439779:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8eef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1868813758931968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782239857.439837:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782239857.439897:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8eef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1868813758931968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239857.439906:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:0.0:1782239857.440126:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb5f46fe300 x1868813758931968/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782239873 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782239857.440158:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f46fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813758931968:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782239857.887735:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1782239858.632532:0:9339:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Tue Jun 23 14:37:36 EDT 2026 00000100:00100000:1.0:1782239858.710848:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239858.710918:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239858.714289:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737927296 00000100:00100000:0.0:1782239858.714312:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737927296 00000100:00080000:1.0:1782239858.714376:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782239858.714432:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 55 00000100:00100000:3.0:1782239858.714498:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737927168 00000100:00100000:3.0:1782239858.714504:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737927168 00000100:00100000:3.0:1782239858.714545:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 202 00000100:00100000:3.0:1782239858.714555:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8d76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afaefb1a-536b-42a3-a3ff-47200f8611c3+10:2347:x1868813737927168:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:3.0:1782239858.714674:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8d76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afaefb1a-536b-42a3-a3ff-47200f8611c3+10:2347:x1868813737927168:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 120us (3836us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239858.714701:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 202 00000100:00100000:0.0:1782239858.715052:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7ce1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+6:2347:x1868813737927296:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:0.0:1782239858.715119:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7ce1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+6:2347:x1868813737927296:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 73us (4200us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239858.719414:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 55 00010000:00010000:3.0:1782239858.913983:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782239859.935023:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782239860.958980:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782239861.023245:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782239861.023275:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5e8eefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813758932096:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782239861.023376:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239861.023526:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758932096 00000100:00100000:2.0:1782239861.023536:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758932096 00000100:00100000:2.0:1782239861.023607:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1782239861.023621:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8eec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1868813758932096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782239861.023669:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782239861.023723:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8eec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1868813758932096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239861.023731:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:2.0:1782239861.023816:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb5e8eefb80 x1868813758932096/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782239877 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782239861.023837:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5e8eefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813758932096:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1782239861.024083:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1782239861.983561:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782239862.052880:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f7ce1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1868813758932352:0@lo:400:kworker.0 00000100:00100000:1.0:1782239862.052978:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239862.053042:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f7ce0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813758932864:0@lo:400:kworker.0 00000100:00100000:1.0:1782239862.053072:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239862.053109:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1782239862.053116:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f7ce2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3305:1868813758932224:0@lo:400:kworker.0 00000100:00100000:1.0:1782239862.053147:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239862.053170:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f7ce2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1868813758932736:0@lo:400:kworker.0 00000100:00100000:1.0:1782239862.053195:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239862.053228:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758932352 00000100:00100000:1.0:1782239862.053239:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758932352 00000100:00100000:1.0:1782239862.053296:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758932736 00000100:00100000:1.0:1782239862.053299:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758932736 00000100:00100000:1.0:1782239862.053335:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1782239862.053345:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7ce0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1868813758932352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782239862.053408:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7ce0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1868813758932352:12345-0@lo:400:kworker.0 Request processed in 64us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239862.053417:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1782239862.053437:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1782239862.053443:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7ce2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1868813758932736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782239862.053472:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7ce2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1868813758932736:12345-0@lo:400:kworker.0 Request processed in 30us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239862.053478:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1782239862.053498:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758932864 00000100:00100000:1.0:1782239862.053515:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758932864 00000100:00100000:1.0:1782239862.053552:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1782239862.053559:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7ce0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1868813758932864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782239862.053593:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7ce0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1868813758932864:12345-0@lo:400:kworker.0 Request processed in 34us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239862.053599:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1782239862.053619:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758932224 00000100:00100000:1.0:1782239862.053622:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758932224 00000100:00100000:1.0:1782239862.053651:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1782239862.053658:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8d74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:3305:x1868813758932224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782239862.053687:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8d74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:3305:x1868813758932224:12345-0@lo:400:kworker.0 Request processed in 29us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239862.053694:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00080000:1.0:1782239862.053726:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782239862.053733:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782239862.053811:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f7ce2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3305:1868813758932224:0@lo:400:kworker.0 00000100:00100000:1.0:1782239862.053826:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f7ce2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1868813758932736:0@lo:400:kworker.0 00000100:00100000:1.0:1782239862.053836:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f7ce1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1868813758932352:0@lo:400:kworker.0 00010000:00080000:1.0:1782239862.053849:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb5f7ce0380 x1868813758932864/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782239878 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782239862.053861:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f7ce0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813758932864:0@lo:400:kworker.0 00000100:00100000:2.0:1782239862.053967:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f7ce1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1868813758932480:0@lo:400:kworker.0 00000100:00100000:2.0:1782239862.054008:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239862.054040:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782239862.054047:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f7ce3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813758932608:0@lo:400:kworker.0 00000100:00100000:2.0:1782239862.054070:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239862.054102:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758932480 00000100:00100000:2.0:1782239862.054106:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758932480 00000100:00100000:2.0:1782239862.054142:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1782239862.054149:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f46fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1868813758932480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782239862.054197:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f46fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1868813758932480:12345-0@lo:400:kworker.0 Request processed in 48us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239862.054204:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1782239862.054223:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758932608 00000100:00100000:2.0:1782239862.054226:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758932608 00000100:00100000:2.0:1782239862.054249:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1782239862.054255:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f46fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1868813758932608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782239862.054286:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f46fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1868813758932608:12345-0@lo:400:kworker.0 Request processed in 31us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239862.054292:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:2.0:1782239862.054311:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1782239862.054330:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb5f7ce3480 x1868813758932608/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782239878 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782239862.054340:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f7ce3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813758932608:0@lo:400:kworker.0 00000100:00100000:2.0:1782239862.054350:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f7ce1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1868813758932480:0@lo:400:kworker.0 00000100:00100000:2.0:1782239862.560538:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f7ce0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813758932992:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782239862.560636:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239862.560810:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758932992 00000100:00100000:2.0:1782239862.560820:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758932992 00000100:00100000:2.0:1782239862.560892:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1782239862.560903:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f46ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1868813758932992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782239862.560949:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782239862.561003:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f46ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1868813758932992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239862.561011:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:2.0:1782239862.561071:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb5f7ce0380 x1868813758932992/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782239878 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782239862.561094:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f7ce0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813758932992:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782239863.007070:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782239863.827837:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239863.827894:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239863.827988:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737927552 00000100:00100000:0.0:1782239863.828003:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737927552 00000100:00100000:0.0:1782239863.828101:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 59 00000100:00100000:0.0:1782239863.828114:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7ce1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+6:2346:x1868813737927552:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:0.0:1782239863.828217:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7ce1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+6:2346:x1868813737927552:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 105us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239863.828225:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 59 00000100:00080000:1.0:1782239863.828305:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782239863.828395:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737927424 00000100:00100000:3.0:1782239863.828401:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737927424 00000100:00100000:3.0:1782239863.828445:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 204 00000100:00100000:3.0:1782239863.828452:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8d76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afaefb1a-536b-42a3-a3ff-47200f8611c3+10:2346:x1868813737927424:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:3.0:1782239863.828484:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8d76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afaefb1a-536b-42a3-a3ff-47200f8611c3+10:2346:x1868813737927424:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 33us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239863.828491:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 204 00010000:00010000:3.0:1782239864.031074:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782239865.058847:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782239866.081567:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782239866.145244:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782239866.145279:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5e8eefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813758933120:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782239866.145381:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239866.146610:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758933120 00000100:00100000:0.0:1782239866.146628:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758933120 00000100:00100000:0.0:1782239866.146716:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1782239866.146776:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1868813758933120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782239866.146833:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782239866.146930:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1868813758933120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 189us (1548us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239866.146938:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1782239866.146978:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1782239866.147026:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb5e8eefb80 x1868813758933120/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782239882 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782239866.147063:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5e8eefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813758933120:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1782239867.102958:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782239867.168630:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fbf25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1868813758933504:0@lo:400:kworker.0 00000100:00100000:3.0:1782239867.168740:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239867.168852:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782239867.168859:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fbf26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813758933632:0@lo:400:kworker.0 00000100:00100000:3.0:1782239867.168890:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239867.168938:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758933504 00000100:00100000:3.0:1782239867.168948:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758933504 00000100:00100000:3.0:1782239867.169016:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1782239867.169031:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fbf27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1868813758933504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782239867.169444:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f48ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1868813758933376:0@lo:400:kworker.0 00000100:00100000:1.0:1782239867.169490:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239867.169515:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fbf27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813758933888:0@lo:400:kworker.0 00000100:00100000:1.0:1782239867.169538:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239867.169569:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1782239867.169575:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f48ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3305:1868813758933248:0@lo:400:kworker.0 00000100:00100000:1.0:1782239867.169605:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239867.169627:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fbf25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1868813758933760:0@lo:400:kworker.0 00000100:00100000:1.0:1782239867.169650:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239867.169676:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758933376 00000100:00100000:1.0:1782239867.169680:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758933376 00000100:00100000:1.0:1782239867.169706:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758933760 00000100:00100000:1.0:1782239867.169709:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758933760 00000100:00100000:1.0:1782239867.169738:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1782239867.169774:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7ce2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1868813758933376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782239867.169825:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7ce2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1868813758933376:12345-0@lo:400:kworker.0 Request processed in 79us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239867.169834:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1782239867.169855:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1782239867.169860:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7ce1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1868813758933760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782239867.169885:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7ce1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1868813758933760:12345-0@lo:400:kworker.0 Request processed in 25us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239867.169891:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1782239867.169909:0:8312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758933632 00000100:00100000:1.0:1782239867.169912:0:8312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758933632 00000100:00100000:1.0:1782239867.169937:0:8312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758933888 00000100:00100000:1.0:1782239867.169940:0:8312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758933888 00000100:00100000:1.0:1782239867.169957:0:8312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1782239867.169969:0:8312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fbf24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1868813758933632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782239867.170005:0:8312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fbf24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1868813758933632:12345-0@lo:400:kworker.0 Request processed in 36us (1115us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239867.170011:0:8312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1782239867.170023:0:8312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1782239867.170029:0:8312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7ce2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1868813758933888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782239867.170055:0:8312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7ce2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1868813758933888:12345-0@lo:400:kworker.0 Request processed in 26us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239867.170061:0:8312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1782239867.170079:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758933248 00000100:00100000:1.0:1782239867.170083:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758933248 00000100:00100000:1.0:1782239867.170109:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1782239867.170115:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8d75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:3305:x1868813758933248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782239867.170144:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8d75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:3305:x1868813758933248:12345-0@lo:400:kworker.0 Request processed in 29us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239867.170150:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1782239867.170221:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f48ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3305:1868813758933248:0@lo:400:kworker.0 00000100:00100000:1.0:1782239867.170237:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fbf25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1868813758933760:0@lo:400:kworker.0 00000100:00100000:1.0:1782239867.170247:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f48ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1868813758933376:0@lo:400:kworker.0 00010000:00080000:1.0:1782239867.170260:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb5fbf27b80 x1868813758933888/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782239883 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782239867.170270:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fbf27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813758933888:0@lo:400:kworker.0 00000100:00100000:3.0:1782239867.171604:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fbf27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1868813758933504:12345-0@lo:400:kworker.0 Request processed in 2569us (2855us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239867.171616:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:3.0:1782239867.171659:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782239867.171665:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1782239867.171695:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb5fbf26680 x1868813758933632/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782239883 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782239867.171708:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fbf26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813758933632:0@lo:400:kworker.0 00000100:00100000:3.0:1782239867.171734:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fbf25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1868813758933504:0@lo:400:kworker.0 00000100:00100000:3.0:1782239867.694503:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5e8eefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813758934016:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782239867.694594:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239867.694677:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758934016 00000100:00100000:3.0:1782239867.694685:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758934016 00000100:00100000:3.0:1782239867.694780:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1782239867.694791:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fbf25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1868813758934016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782239867.694837:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782239867.694889:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fbf25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1868813758934016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239867.694898:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:3.0:1782239867.694962:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb5e8eefb80 x1868813758934016/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782239883 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782239867.694984:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5e8eefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813758934016:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782239868.129803:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782239868.951647:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239868.951694:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239868.951742:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737927808 00000100:00100000:1.0:1782239868.951742:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737927680 00000100:00100000:2.0:1782239868.951762:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737927808 00000100:00100000:1.0:1782239868.951762:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737927680 00000100:00100000:2.0:1782239868.951811:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 63 00000100:00100000:2.0:1782239868.951822:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f46ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+6:2345:x1868813737927808:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:1.0:1782239868.951879:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 206 00000100:00100000:1.0:1782239868.951889:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8d75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afaefb1a-536b-42a3-a3ff-47200f8611c3+10:2345:x1868813737927680:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:2.0:1782239868.951892:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f46ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+6:2345:x1868813737927808:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 73us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239868.951899:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 63 00000100:00100000:1.0:1782239868.951915:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8d75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afaefb1a-536b-42a3-a3ff-47200f8611c3+10:2345:x1868813737927680:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 29us (278us total) trans 0 rc 0/0 00000100:00080000:2.0:1782239868.951919:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782239868.951921:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 206 00010000:00010000:2.0:1782239869.152058:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782239870.175061:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782239871.206398:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782239871.263954:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782239871.264103:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f46fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813758934144:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782239871.264172:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239871.264613:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758934144 00000100:00100000:3.0:1782239871.264632:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758934144 00000100:00100000:3.0:1782239871.264738:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1782239871.264776:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8eefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1868813758934144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782239871.264811:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782239871.264864:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8eefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1868813758934144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239871.264871:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:0.0:1782239871.265003:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb5f46fe300 x1868813758934144/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782239887 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782239871.265033:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f46fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813758934144:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1782239871.265130:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1782239872.233547:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782239872.291014:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5e8ec8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3304:1868813758934272:0@lo:400:kworker.0 00000100:00100000:1.0:1782239872.291087:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239872.291292:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758934272 00000100:00100000:2.0:1782239872.291300:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758934272 00000100:00100000:2.0:1782239872.291342:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1782239872.291361:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8d77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:3304:x1868813758934272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782239872.298950:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5e8ec8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1868813758934400:0@lo:400:kworker.0 00000100:00100000:2.0:1782239872.299034:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8d77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:3304:x1868813758934272:12345-0@lo:400:kworker.0 Request processed in 7681us (7944us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239872.299044:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1782239872.299210:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5e8ec8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3304:1868813758934272:0@lo:400:kworker.0 00000100:00100000:0.0:1782239872.299311:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239872.299433:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758934400 00000100:00100000:1.0:1782239872.299439:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758934400 00000100:00100000:1.0:1782239872.299488:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1782239872.299497:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8ecb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1868813758934400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782239872.299557:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8ecb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1868813758934400:12345-0@lo:400:kworker.0 Request processed in 60us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239872.299565:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1782239872.299582:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5e8ec8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1868813758934400:0@lo:400:kworker.0 00000100:00100000:0.0:1782239872.299604:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5e8ec9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1868813758934528:0@lo:400:kworker.0 00000100:00100000:0.0:1782239872.299630:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239872.299702:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782239872.299710:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5e8ec8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813758934656:0@lo:400:kworker.0 00000100:00100000:0.0:1782239872.299803:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239872.299831:0:8312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758934656 00000100:00100000:0.0:1782239872.299848:0:8312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758934656 00000100:00100000:0.0:1782239872.299883:0:8312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1782239872.299891:0:8312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5eddf7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1868813758934656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782239872.299931:0:8312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5eddf7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1868813758934656:12345-0@lo:400:kworker.0 Request processed in 41us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239872.299939:0:8312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1782239872.299972:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758934528 00010000:00080000:0.0:1782239872.299976:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb5e8ec8380 x1868813758934656/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782239888 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782239872.299983:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758934528 00000100:00100000:0.0:1782239872.300003:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5e8ec8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813758934656:0@lo:400:kworker.0 00000100:00100000:2.0:1782239872.300035:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1782239872.300048:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5eddf6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1868813758934784:0@lo:400:kworker.0 00000100:00100000:2.0:1782239872.300049:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8ec8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1868813758934528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782239872.300085:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239872.300107:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8ec8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1868813758934528:12345-0@lo:400:kworker.0 Request processed in 63us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239872.300115:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1782239872.300130:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758934784 00000100:00100000:2.0:1782239872.300134:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758934784 00000100:00100000:0.0:1782239872.300158:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5eddf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813758934912:0@lo:400:kworker.0 00000100:00100000:2.0:1782239872.300166:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1782239872.300173:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5eddf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1868813758934784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782239872.300328:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5eddf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1868813758934784:12345-0@lo:400:kworker.0 Request processed in 155us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239872.300335:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:2.0:1782239872.300418:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782239872.300444:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5e8ec9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1868813758934528:0@lo:400:kworker.0 00000100:00100000:0.0:1782239872.301281:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239872.301381:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5eddf6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1868813758934784:0@lo:400:kworker.0 00000100:00100000:1.0:1782239872.301427:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758934912 00000100:00100000:1.0:1782239872.301432:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758934912 00000100:00080000:2.0:1782239872.301513:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782239872.301515:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1782239872.301526:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5eddf4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1868813758934912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782239872.301579:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5eddf4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1868813758934912:12345-0@lo:400:kworker.0 Request processed in 55us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239872.301586:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:2.0:1782239872.301652:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb5eddf4a80 x1868813758934912/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782239888 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782239872.301664:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5eddf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813758934912:0@lo:400:kworker.0 00000100:00100000:0.0:1782239872.799930:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5eddf6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813758935040:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782239872.800013:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239872.801270:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758935040 00000100:00100000:3.0:1782239872.801280:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758935040 00000100:00100000:3.0:1782239872.801334:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1782239872.801342:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5eddf6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1868813758935040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782239872.801382:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782239872.801439:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5eddf6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1868813758935040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (1438us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239872.801446:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:0.0:1782239872.801795:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb5eddf6a00 x1868813758935040/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782239888 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782239872.801814:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5eddf6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813758935040:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782239873.248135:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782239874.076268:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239874.076318:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239874.076411:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737927936 00000100:00100000:1.0:1782239874.076421:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737927936 00000100:00100000:1.0:1782239874.076473:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 208 00000100:00100000:1.0:1782239874.076483:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8d75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afaefb1a-536b-42a3-a3ff-47200f8611c3+10:2346:x1868813737927936:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:1.0:1782239874.076587:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8d75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afaefb1a-536b-42a3-a3ff-47200f8611c3+10:2346:x1868813737927936:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 105us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239874.076595:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 208 00000100:00100000:0.0:1782239874.076797:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737928064 00000100:00100000:0.0:1782239874.076802:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737928064 00000100:00100000:0.0:1782239874.076856:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 67 00000100:00100000:0.0:1782239874.076865:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f46fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+6:2346:x1868813737928064:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:0.0:1782239874.076899:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f46fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+6:2346:x1868813737928064:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 37us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239874.076914:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 67 00000100:00080000:3.0:1782239874.077054:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1782239874.270943:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782239875.295172:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1782239876.206194:0:9969:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 14:37:54 (1782239874) === 00010000:00010000:3.0:1782239876.325681:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782239876.385550:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f46ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1868813758935168:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782239876.385629:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239876.385887:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758935168 00000100:00100000:2.0:1782239876.385895:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758935168 00000100:00100000:2.0:1782239876.385952:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1782239876.385975:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7ce0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1868813758935168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782239876.386011:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782239876.386058:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7ce0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1868813758935168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239876.386065:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:2.0:1782239876.386085:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1782239876.386115:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb5f46ff480 x1868813758935168/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782239892 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782239876.386133:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f46ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1868813758935168:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782239876.976146:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239876.976241:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737928192 00000100:00100000:1.0:1782239876.976250:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737928192 00000100:00100000:1.0:1782239876.976309:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 209 00000100:00100000:1.0:1782239876.976319:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8d74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afaefb1a-536b-42a3-a3ff-47200f8611c3+10:8116:x1868813737928192:12345-192.168.203.32@tcp:101:mount.lustre.0 00010000:00010000:1.0:1782239876.976345:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782239876.976364:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb5c1677e00/0x8c5345f1c1ec4d2e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e3f1 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239876.976392:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb5c1677e00/0x8c5345f1c1ec4d2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e3f1 expref: 11 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239876.976403:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb5c1677e00/0x8c5345f1c1ec4d2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e3f1 expref: 11 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239876.976412:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5c1677e00, rc 0) 00000100:00100000:1.0:1782239876.976471:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8d74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afaefb1a-536b-42a3-a3ff-47200f8611c3+11:8116:x1868813737928192:12345-192.168.203.32@tcp:101:mount.lustre.0 Request processed in 153us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239876.976480:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 209 00000100:00100000:2.0:1782239876.981638:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239876.981791:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737928320 00000100:00100000:3.0:1782239876.981801:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737928320 00000100:00100000:3.0:1782239876.981861:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 210 00000100:00100000:3.0:1782239876.981871:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8d74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afaefb1a-536b-42a3-a3ff-47200f8611c3+11:8116:x1868813737928320:12345-192.168.203.32@tcp:501:mount.lustre.0 00000100:00100000:3.0:1782239876.982374:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8d74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afaefb1a-536b-42a3-a3ff-47200f8611c3+11:8116:x1868813737928320:12345-192.168.203.32@tcp:501:mount.lustre.0 Request processed in 502us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239876.982383:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 210 00000100:00100000:3.0:1782239876.995254:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239876.995430:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737928448 00000100:00100000:2.0:1782239876.995439:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737928448 00000100:00100000:2.0:1782239876.995551:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 211 00000100:00100000:2.0:1782239876.995561:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8d74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afaefb1a-536b-42a3-a3ff-47200f8611c3+11:8116:x1868813737928448:12345-192.168.203.32@tcp:503:mount.lustre.0 00000100:00100000:3.0:1782239876.996105:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8d74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afaefb1a-536b-42a3-a3ff-47200f8611c3+11:8116:x1868813737928448:12345-192.168.203.32@tcp:503:mount.lustre.0 Request processed in 543us (858us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239876.996125:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 211 00000100:00100000:2.0:1782239877.004982:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239877.005160:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737928576 00000100:00100000:3.0:1782239877.005170:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737928576 00000100:00100000:3.0:1782239877.005251:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 212 00000100:00100000:3.0:1782239877.005281:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8d77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afaefb1a-536b-42a3-a3ff-47200f8611c3+11:8120:x1868813737928576:12345-192.168.203.32@tcp:502:llog_process_th.0 00000100:00100000:3.0:1782239877.005911:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8d77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afaefb1a-536b-42a3-a3ff-47200f8611c3+11:8120:x1868813737928576:12345-192.168.203.32@tcp:502:llog_process_th.0 Request processed in 648us (939us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239877.005924:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 212 00000100:00100000:2.0:1782239877.039196:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239877.039316:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737928704 00000100:00100000:3.0:1782239877.039326:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737928704 00000100:00100000:3.0:1782239877.039384:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 213 00000100:00100000:3.0:1782239877.039394:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8d77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afaefb1a-536b-42a3-a3ff-47200f8611c3+11:8120:x1868813737928704:12345-192.168.203.32@tcp:502:llog_process_th.0 00000100:00100000:3.0:1782239877.039664:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8d77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afaefb1a-536b-42a3-a3ff-47200f8611c3+11:8120:x1868813737928704:12345-192.168.203.32@tcp:502:llog_process_th.0 Request processed in 270us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239877.039673:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 213 00000100:00100000:2.0:1782239877.047169:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239877.047275:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737928832 00000100:00100000:3.0:1782239877.047291:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737928832 00000100:00100000:3.0:1782239877.047367:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 214 00000100:00100000:3.0:1782239877.047378:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8d76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afaefb1a-536b-42a3-a3ff-47200f8611c3+11:8116:x1868813737928832:12345-192.168.203.32@tcp:101:mount.lustre.0 00010000:00010000:3.0:1782239877.047399:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782239877.047421:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb5c2a45800/0x8c5345f1c1ec4d35 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e41b expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239877.047457:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb5c2a45800/0x8c5345f1c1ec4d35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e41b expref: 12 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239877.047495:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb5c2a45800/0x8c5345f1c1ec4d35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e41b expref: 12 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239877.047505:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5c2a45800, rc 0) 00000100:00100000:3.0:1782239877.047584:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8d76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afaefb1a-536b-42a3-a3ff-47200f8611c3+12:8116:x1868813737928832:12345-192.168.203.32@tcp:101:mount.lustre.0 Request processed in 207us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239877.047591:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 214 00000100:00100000:2.0:1782239877.052585:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239877.053380:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737928960 00000100:00100000:3.0:1782239877.053398:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737928960 00000100:00100000:3.0:1782239877.053547:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 215 00000100:00100000:3.0:1782239877.053561:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8d77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afaefb1a-536b-42a3-a3ff-47200f8611c3+12:8116:x1868813737928960:12345-192.168.203.32@tcp:256:mount.lustre.0 20000000:01000000:3.0:1782239877.053599:0:5785:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1782239877.053632:0:5785:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1782239877.053636:0:5785:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1782239877.053640:0:5785:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1782239877.053642:0:5785:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1782239877.062357:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8d77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afaefb1a-536b-42a3-a3ff-47200f8611c3+12:8116:x1868813737928960:12345-192.168.203.32@tcp:256:mount.lustre.0 Request processed in 8788us (9769us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239877.062373:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 215 00000100:00100000:2.0:1782239877.064999:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239877.065423:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737929088 00000100:00100000:3.0:1782239877.065432:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737929088 00000100:00100000:3.0:1782239877.065500:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 216 00000100:00100000:3.0:1782239877.065509:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d1bad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afaefb1a-536b-42a3-a3ff-47200f8611c3+12:8116:x1868813737929088:12345-192.168.203.32@tcp:101:mount.lustre.0 00010000:00010000:3.0:1782239877.065526:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782239877.065543:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb5c2a44200/0x8c5345f1c1ec4d3c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e422 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239877.065592:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb5c2a44200/0x8c5345f1c1ec4d3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e422 expref: 13 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239877.065604:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb5c2a44200/0x8c5345f1c1ec4d3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e422 expref: 13 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239877.065612:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5c2a44200, rc 0) 00000100:00100000:3.0:1782239877.065681:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d1bad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afaefb1a-536b-42a3-a3ff-47200f8611c3+13:8116:x1868813737929088:12345-192.168.203.32@tcp:101:mount.lustre.0 Request processed in 173us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239877.065687:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 216 00000100:00100000:2.0:1782239877.069887:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239877.070011:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737929216 00000100:00100000:3.0:1782239877.070029:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737929216 00000100:00100000:3.0:1782239877.070085:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 217 00000100:00100000:3.0:1782239877.070095:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d1bae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afaefb1a-536b-42a3-a3ff-47200f8611c3+13:8116:x1868813737929216:12345-192.168.203.32@tcp:501:mount.lustre.0 00000100:00100000:3.0:1782239877.070511:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d1bae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afaefb1a-536b-42a3-a3ff-47200f8611c3+13:8116:x1868813737929216:12345-192.168.203.32@tcp:501:mount.lustre.0 Request processed in 415us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239877.070519:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 217 00000100:00100000:2.0:1782239877.081006:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239877.087254:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737929344 00000100:00100000:1.0:1782239877.087268:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737929344 00000100:00100000:0.0:1782239877.087567:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 218 00000100:00100000:0.0:1782239877.087580:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d1bac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afaefb1a-536b-42a3-a3ff-47200f8611c3+13:8116:x1868813737929344:12345-192.168.203.32@tcp:503:mount.lustre.0 00000100:00100000:0.0:1782239877.087847:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d1bac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afaefb1a-536b-42a3-a3ff-47200f8611c3+13:8116:x1868813737929344:12345-192.168.203.32@tcp:503:mount.lustre.0 Request processed in 269us (6859us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239877.087856:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 218 00000100:00100000:2.0:1782239877.094938:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239877.095230:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737929472 00000100:00100000:3.0:1782239877.095239:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737929472 00000100:00100000:3.0:1782239877.095344:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 219 00000100:00100000:3.0:1782239877.095354:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d1baec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afaefb1a-536b-42a3-a3ff-47200f8611c3+13:8123:x1868813737929472:12345-192.168.203.32@tcp:502:llog_process_th.0 00000100:00100000:3.0:1782239877.095597:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d1baec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afaefb1a-536b-42a3-a3ff-47200f8611c3+13:8123:x1868813737929472:12345-192.168.203.32@tcp:502:llog_process_th.0 Request processed in 244us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239877.095605:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 219 00000100:00100000:2.0:1782239877.105001:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239877.109812:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737929600 00000100:00100000:1.0:1782239877.109843:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737929600 00000100:00100000:2.0:1782239877.110255:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 220 00000100:00100000:2.0:1782239877.110267:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d1bad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afaefb1a-536b-42a3-a3ff-47200f8611c3+13:8123:x1868813737929600:12345-192.168.203.32@tcp:502:llog_process_th.0 00000100:00100000:2.0:1782239877.110533:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d1bad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afaefb1a-536b-42a3-a3ff-47200f8611c3+13:8123:x1868813737929600:12345-192.168.203.32@tcp:502:llog_process_th.0 Request processed in 267us (5550us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239877.110541:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 220 00000100:00100000:2.0:1782239877.120468:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239877.120534:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239877.120620:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737929984 00000100:00100000:3.0:1782239877.120639:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737929984 00000100:00100000:3.0:1782239877.120717:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737929728 00000100:00100000:3.0:1782239877.120721:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737929728 00000100:00100000:3.0:1782239877.120740:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 68 00000100:00100000:3.0:1782239877.120779:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f46ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+6:2345:x1868813737929984:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:3.0:1782239877.120848:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f46ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+6:2345:x1868813737929984:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 99us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239877.120856:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 68 00000100:00100000:3.0:1782239877.120872:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 10 00000100:00100000:3.0:1782239877.120877:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f46fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2343:x1868813737929728:12345-192.168.203.32@tcp:38:mount.lustre.0 00010000:00080000:3.0:1782239877.120896:0:5791:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from f135cc01-3d42-4f2a-80ff-79724f1d3285@192.168.203.32@tcp t0 exp 0000000000000000 cur 256 last 0 00000020:00000080:3.0:1782239877.120928:0:5791:0:(genops.c:1406:class_connect()) connect: client f135cc01-3d42-4f2a-80ff-79724f1d3285, cookie 0x8c5345f1c1ec4d43 00000004:00100000:3.0:1782239877.120957:0:5791:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1782239877.121210:0:5791:0:(import.c:65:import_set_state_nolock()) ffff9bb5f7cdd000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782239877.121243:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f46fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f135cc01-3d42-4f2a-80ff-79724f1d3285+6:2343:x1868813737929728:12345-192.168.203.32@tcp:38:mount.lustre.0 Request processed in 364us (709us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239877.121250:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 10 00000100:00080000:2.0:1782239877.122003:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782239877.127687:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239877.129469:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239877.129554:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737929856 00000100:00100000:1.0:1782239877.129563:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737929856 00000100:00100000:1.0:1782239877.129627:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737930112 00000100:00100000:1.0:1782239877.129629:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737930112 00000100:00100000:1.0:1782239877.129659:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 11 00000100:00100000:1.0:1782239877.129667:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fbf26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f135cc01-3d42-4f2a-80ff-79724f1d3285+7:0:x1868813737929856:12345-192.168.203.32@tcp:41:mount.lustre.0 00000004:00000024:1.0:1782239877.129706:0:5792:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1782239877.129821:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fbf26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f135cc01-3d42-4f2a-80ff-79724f1d3285+7:0:x1868813737929856:12345-192.168.203.32@tcp:41:mount.lustre.0 Request processed in 154us (2142us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239877.129829:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 11 00000100:00100000:1.0:1782239877.129844:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 12 00000100:00100000:1.0:1782239877.129850:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5eddf6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f135cc01-3d42-4f2a-80ff-79724f1d3285+6:8116:x1868813737930112:12345-192.168.203.32@tcp:41:mount.lustre.0 00000004:00000024:1.0:1782239877.129859:0:5792:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1782239877.129876:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5eddf6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f135cc01-3d42-4f2a-80ff-79724f1d3285+6:8116:x1868813737930112:12345-192.168.203.32@tcp:41:mount.lustre.0 Request processed in 27us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239877.129882:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 12 00000100:00080000:3.0:1782239877.129993:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782239877.132947:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239877.133084:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737930240 00000100:00100000:1.0:1782239877.133093:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737930240 00000100:00100000:1.0:1782239877.133152:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 13 00000100:00100000:1.0:1782239877.133162:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fbf27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f135cc01-3d42-4f2a-80ff-79724f1d3285+6:8116:x1868813737930240:12345-192.168.203.32@tcp:40:mount.lustre.0 00000100:00100000:1.0:1782239877.133248:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fbf27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f135cc01-3d42-4f2a-80ff-79724f1d3285+6:8116:x1868813737930240:12345-192.168.203.32@tcp:40:mount.lustre.0 Request processed in 87us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239877.133256:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 13 00000100:00100000:1.0:1782239877.136146:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239877.136189:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239877.136239:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239877.136359:0:8312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737930368 00000100:00100000:0.0:1782239877.136368:0:8312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737930368 00000100:00100000:0.0:1782239877.136407:0:8312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737930496 00000100:00100000:0.0:1782239877.136410:0:8312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737930496 00000100:00100000:0.0:1782239877.136431:0:8312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 12 00000100:00100000:0.0:1782239877.136438:0:8312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7ce0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2343:x1868813737930368:12345-192.168.203.32@tcp:8:mount.lustre.0 00010000:00080000:0.0:1782239877.136467:0:8312:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from f135cc01-3d42-4f2a-80ff-79724f1d3285@192.168.203.32@tcp t0 exp 0000000000000000 cur 256 last 0 00000020:00000080:0.0:1782239877.136495:0:8312:0:(genops.c:1406:class_connect()) connect: client f135cc01-3d42-4f2a-80ff-79724f1d3285, cookie 0x8c5345f1c1ec4d4a 00002000:00100000:0.0:1782239877.136508:0:8312:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f135cc01-3d42-4f2a-80ff-79724f1d3285/ffff9bb5d819f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1782239877.136518:0:8312:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1782239877.136727:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 13 00000100:00100000:3.0:1782239877.136734:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7ce1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2343:x1868813737930496:12345-192.168.203.32@tcp:8:mount.lustre.0 00010000:00080000:3.0:1782239877.136770:0:6588:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from f135cc01-3d42-4f2a-80ff-79724f1d3285@192.168.203.32@tcp t0 exp 0000000000000000 cur 256 last 0 00002000:00080000:0.0:1782239877.136781:0:8312:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000020:00000080:3.0:1782239877.136787:0:6588:0:(genops.c:1406:class_connect()) connect: client f135cc01-3d42-4f2a-80ff-79724f1d3285, cookie 0x8c5345f1c1ec4d51 00002000:00100000:3.0:1782239877.136792:0:6588:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f135cc01-3d42-4f2a-80ff-79724f1d3285/ffff9bb5f7cd9000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000100:00080000:0.0:1782239877.136808:0:8312:0:(import.c:65:import_set_state_nolock()) ffff9bb5d819c000 : changing import state from RECOVER to FULL 00002000:00100000:3.0:1782239877.136815:0:6588:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:0.0:1782239877.136867:0:8312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7ce0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f135cc01-3d42-4f2a-80ff-79724f1d3285+6:2343:x1868813737930368:12345-192.168.203.32@tcp:8:mount.lustre.0 Request processed in 428us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239877.136875:0:8312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 12 00002000:00080000:3.0:1782239877.136939:0:6588:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1782239877.136953:0:6588:0:(import.c:65:import_set_state_nolock()) ffff9bb5f7cde800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782239877.136977:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7ce1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f135cc01-3d42-4f2a-80ff-79724f1d3285+6:2343:x1868813737930496:12345-192.168.203.32@tcp:8:mount.lustre.0 Request processed in 242us (738us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239877.136984:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 13 00000100:00100000:2.0:1782239877.137106:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737930624 00000100:00100000:2.0:1782239877.137110:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737930624 00000100:00100000:2.0:1782239877.137159:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 1 00000100:00100000:2.0:1782239877.137168:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7ce3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f135cc01-3d42-4f2a-80ff-79724f1d3285+6:8116:x1868813737930624:12345-192.168.203.32@tcp:33:mount.lustre.0 00000004:00200000:2.0:1782239877.137625:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:2.0:1782239877.137788:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7ce3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f135cc01-3d42-4f2a-80ff-79724f1d3285+6:8116:x1868813737930624:12345-192.168.203.32@tcp:33:mount.lustre.0 Request processed in 620us (1650us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239877.137796:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 1 00010000:00010000:2.0:1782239877.348079:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782239877.408941:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f7e0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1868813758935424:0@lo:400:kworker.0 00000100:00100000:3.0:1782239877.408991:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f7e0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1868813758935680:0@lo:400:kworker.0 00000100:00100000:3.0:1782239877.409024:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239877.409024:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239877.409087:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fbf25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3304:1868813758935296:0@lo:400:kworker.0 00000100:00100000:1.0:1782239877.409156:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f7e0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1868813758935552:0@lo:400:kworker.0 00000100:00100000:2.0:1782239877.415121:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f7e0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813758935936:0@lo:400:kworker.0 00000100:00100000:2.0:1782239877.415179:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239877.415237:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758935680 00000100:00100000:2.0:1782239877.415244:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758935680 00000100:00100000:2.0:1782239877.415296:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758935936 00000100:00100000:2.0:1782239877.415299:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758935936 00000100:00100000:2.0:1782239877.415333:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1782239877.415342:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7e0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1868813758935680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782239877.415802:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7e0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1868813758935680:12345-0@lo:400:kworker.0 Request processed in 459us (6776us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239877.415897:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1782239877.415917:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1782239877.415926:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f46fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1868813758935936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782239877.415967:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f46fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1868813758935936:12345-0@lo:400:kworker.0 Request processed in 43us (788us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239877.415974:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1782239877.416434:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758935424 00000100:00100000:2.0:1782239877.416441:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758935424 00000100:00100000:2.0:1782239877.416472:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1782239877.416478:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f46fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1868813758935424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782239877.416515:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f46fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1868813758935424:12345-0@lo:400:kworker.0 Request processed in 37us (7492us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239877.416520:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:2.0:1782239877.416537:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1782239877.416569:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb5f7e0ce00 x1868813758935936/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782239893 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782239877.416583:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f7e0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813758935936:0@lo:400:kworker.0 00000100:00100000:2.0:1782239877.416596:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f7e0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1868813758935424:0@lo:400:kworker.0 00000100:00100000:1.0:1782239877.417462:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1782239877.417588:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb5f7e0e300 x1868813758935680/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782239893 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782239877.417602:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f7e0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1868813758935680:0@lo:400:kworker.0 00000100:00100000:0.0:1782239877.421253:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239877.421343:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f7e0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1868813758935808:0@lo:400:kworker.0 00000100:00100000:0.0:1782239877.421384:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239877.421611:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758935552 00000100:00100000:1.0:1782239877.421620:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758935552 00000100:00100000:1.0:1782239877.421689:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758935808 00000100:00100000:1.0:1782239877.421692:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758935808 00000100:00100000:1.0:1782239877.421717:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1782239877.421725:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7ce3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1868813758935552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782239877.421768:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1782239877.421778:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5eddf5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1868813758935808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782239877.421800:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7ce3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1868813758935552:12345-0@lo:400:kworker.0 Request processed in 76us (4341us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239877.421808:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1782239877.421812:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5eddf5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1868813758935808:12345-0@lo:400:kworker.0 Request processed in 38us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239877.421817:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1782239877.421849:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f7e0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1868813758935552:0@lo:400:kworker.0 00000100:00080000:0.0:1782239877.422351:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782239877.422376:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f7e0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1868813758935808:0@lo:400:kworker.0 00000100:00100000:3.0:1782239877.422477:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758935296 00000100:00100000:3.0:1782239877.422482:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758935296 00000100:00100000:3.0:1782239877.422519:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1782239877.422526:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d1bad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:3304:x1868813758935296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782239877.422633:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d1bad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:3304:x1868813758935296:12345-0@lo:400:kworker.0 Request processed in 108us (1388us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239877.422640:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1782239877.423126:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fbf25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3304:1868813758935296:0@lo:400:kworker.0 00000100:00100000:2.0:1782239877.923884:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f48ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813758936064:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782239877.923962:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239877.925823:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758936064 00000100:00100000:1.0:1782239877.925835:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758936064 00000100:00100000:1.0:1782239877.925890:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1782239877.925900:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5dee26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1868813758936064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782239877.925927:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782239877.926001:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5dee26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1868813758936064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (2038us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239877.926008:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:1.0:1782239877.926052:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb5f48ed880 x1868813758936064/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782239893 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782239877.926071:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f48ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813758936064:0@lo:13:osp-pre-1-0.0 00000001:00100000:2.0:1782239877.973099:0:7493:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f135cc01-3d42-4f2a-80ff-79724f1d3285 00010000:00010000:2.0:1782239878.370869:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1782239878.471449:0:5812:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f135cc01-3d42-4f2a-80ff-79724f1d3285 00010000:00010000:2.0:1782239879.390896:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1782239880.069290:0:6614:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f135cc01-3d42-4f2a-80ff-79724f1d3285 00010000:00010000:2.0:1782239880.417296:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782239881.439252:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782239881.503199:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5dee25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1868813758936192:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782239881.503304:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239881.503584:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758936192 00000100:00100000:2.0:1782239881.503595:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758936192 00000100:00080000:0.0:1782239881.504062:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782239881.504115:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1782239881.504129:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7e0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1868813758936192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782239881.504184:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782239881.504264:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7e0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1868813758936192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 138us (960us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239881.504272:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:3.0:1782239881.504357:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb5dee25500 x1868813758936192/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782239897 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782239881.504381:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5dee25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1868813758936192:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782239882.263653:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239882.263793:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239882.263833:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239882.263874:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239882.263905:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239882.264244:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737931264 00000100:00100000:3.0:1782239882.264259:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737931264 00000100:00100000:3.0:1782239882.264336:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737931136 00000100:00100000:3.0:1782239882.264339:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737931136 00000100:00100000:3.0:1782239882.264368:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 39 00000100:00100000:3.0:1782239882.264381:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f135cc01-3d42-4f2a-80ff-79724f1d3285+5:2346:x1868813737931264:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:3.0:1782239882.264482:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f135cc01-3d42-4f2a-80ff-79724f1d3285+5:2346:x1868813737931264:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 103us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239882.264491:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 39 00000100:00100000:3.0:1782239882.264511:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 40 00000100:00100000:3.0:1782239882.264518:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f780ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f135cc01-3d42-4f2a-80ff-79724f1d3285+5:2346:x1868813737931136:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:3.0:1782239882.264546:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f780ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f135cc01-3d42-4f2a-80ff-79724f1d3285+5:2346:x1868813737931136:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 28us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239882.264552:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 40 00000100:00080000:3.0:1782239882.264734:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782239882.264739:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782239882.265178:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737931008 00000100:00100000:2.0:1782239882.265186:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737931008 00000100:00100000:2.0:1782239882.265250:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737930880 00000100:00100000:2.0:1782239882.265253:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737930880 00000100:00100000:2.0:1782239882.265281:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 72 00000100:00100000:2.0:1782239882.265289:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f135cc01-3d42-4f2a-80ff-79724f1d3285+5:2346:x1868813737931008:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:2.0:1782239882.265340:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f135cc01-3d42-4f2a-80ff-79724f1d3285+5:2346:x1868813737931008:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 51us (1546us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239882.265348:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 72 00000100:00100000:2.0:1782239882.265361:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 73 00000100:00100000:2.0:1782239882.265367:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f780e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+6:2346:x1868813737930880:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:2.0:1782239882.265398:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f780e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+6:2346:x1868813737930880:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 31us (1524us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239882.265425:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 73 00000100:00080000:3.0:1782239882.266419:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782239882.266581:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737930752 00000100:00100000:0.0:1782239882.266590:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737930752 00000100:00100000:0.0:1782239882.266650:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 222 00000100:00100000:0.0:1782239882.266659:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d1baf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afaefb1a-536b-42a3-a3ff-47200f8611c3+13:2346:x1868813737930752:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:0.0:1782239882.266726:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d1baf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afaefb1a-536b-42a3-a3ff-47200f8611c3+13:2346:x1868813737930752:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 69us (3090us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239882.266733:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 222 00010000:00010000:2.0:1782239882.462898:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782239882.527098:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5dee24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1868813758936576:0@lo:400:kworker.0 00000100:00100000:2.0:1782239882.527218:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239882.527295:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782239882.527302:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5dee26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813758936704:0@lo:400:kworker.0 00000100:00100000:2.0:1782239882.527332:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239882.527375:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758936576 00000100:00100000:2.0:1782239882.527384:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758936576 00000100:00100000:2.0:1782239882.527483:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1782239882.527496:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f77f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1868813758936576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782239882.527568:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f77f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1868813758936576:12345-0@lo:400:kworker.0 Request processed in 74us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239882.527577:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1782239882.527604:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758936704 00000100:00100000:2.0:1782239882.527617:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758936704 00000100:00100000:2.0:1782239882.527644:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1782239882.527651:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f77f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1868813758936704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782239882.527684:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f77f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1868813758936704:12345-0@lo:400:kworker.0 Request processed in 33us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239882.527692:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:2.0:1782239882.527709:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1782239882.527778:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb5dee26680 x1868813758936704/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782239898 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782239882.527794:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5dee26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813758936704:0@lo:400:kworker.0 00000100:00100000:2.0:1782239882.527820:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5dee24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1868813758936576:0@lo:400:kworker.0 00000100:00100000:3.0:1782239882.528619:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5dee24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1868813758936448:0@lo:400:kworker.0 00000100:00100000:3.0:1782239882.528680:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239882.528718:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f77f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813758936960:0@lo:400:kworker.0 00000100:00100000:3.0:1782239882.528779:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239882.528816:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1782239882.528824:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5dee24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3305:1868813758936320:0@lo:400:kworker.0 00000100:00100000:3.0:1782239882.528855:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239882.528875:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5dee25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1868813758936832:0@lo:400:kworker.0 00000100:00100000:3.0:1782239882.528925:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239882.528966:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758936448 00000100:00100000:3.0:1782239882.528971:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758936448 00000100:00100000:3.0:1782239882.529010:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758936832 00000100:00100000:3.0:1782239882.529013:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758936832 00000100:00100000:3.0:1782239882.529039:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1782239882.529283:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7e0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1868813758936448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782239882.529352:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7e0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1868813758936448:12345-0@lo:400:kworker.0 Request processed in 304us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239882.529360:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1782239882.529376:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1782239882.529383:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7e0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1868813758936832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782239882.529410:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7e0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1868813758936832:12345-0@lo:400:kworker.0 Request processed in 29us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239882.529416:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1782239882.529532:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758936960 00000100:00100000:2.0:1782239882.529538:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758936960 00000100:00100000:2.0:1782239882.529577:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1782239882.529584:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f4532050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1868813758936960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782239882.529633:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f4532050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1868813758936960:12345-0@lo:400:kworker.0 Request processed in 49us (853us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239882.529638:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1782239882.529869:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758936320 00000100:00100000:2.0:1782239882.529873:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758936320 00000100:00100000:3.0:1782239882.530343:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5dee25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1868813758936832:0@lo:400:kworker.0 00000100:00100000:3.0:1782239882.530368:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5dee24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1868813758936448:0@lo:400:kworker.0 00010000:00080000:3.0:1782239882.530384:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb5f77f2a00 x1868813758936960/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782239898 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782239882.530397:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f77f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813758936960:0@lo:400:kworker.0 00000100:00080000:3.0:1782239882.530986:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782239882.530995:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782239882.532344:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1782239882.532359:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d1badc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:3305:x1868813758936320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782239882.534395:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d1badc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:3305:x1868813758936320:12345-0@lo:400:kworker.0 Request processed in 2028us (5526us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239882.534435:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1782239882.534699:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5dee24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3305:1868813758936320:0@lo:400:kworker.0 00000100:00100000:1.0:1782239883.040490:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782239883.040512:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f780c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1868813758937088:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782239883.040581:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239883.040645:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758937088 00000100:00100000:1.0:1782239883.040652:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758937088 00000100:00100000:1.0:1782239883.040698:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1782239883.040707:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f780f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1868813758937088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782239883.040742:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782239883.040805:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f780f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1868813758937088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239883.040811:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:1.0:1782239883.041977:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb5f780c380 x1868813758937088/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782239899 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782239883.042000:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f780c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1868813758937088:0@lo:13:osp-pre-1-0.0 00000001:02000400:2.0:1782239883.408570:0:10166:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg332-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:2.0:1782239883.486860:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782239884.511343:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782239885.535646:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782239886.560922:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782239886.624099:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f77f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1868813758937216:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782239886.624172:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239886.624241:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758937216 00000100:00100000:2.0:1782239886.624248:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758937216 00000100:00100000:2.0:1782239886.624297:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1782239886.624307:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f77f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1868813758937216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782239886.624341:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782239886.624381:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f77f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1868813758937216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239886.624388:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:2.0:1782239886.624413:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1782239886.624440:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb5f77f0a80 x1868813758937216/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782239902 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782239886.624457:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f77f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1868813758937216:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782239887.395012:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239887.395059:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239887.395086:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737931392 00000100:00100000:1.0:1782239887.395096:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737931392 00000100:00100000:3.0:1782239887.395139:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239887.395176:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239887.395232:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737931904 00000100:00100000:0.0:1782239887.395237:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737931904 00000100:00100000:1.0:1782239887.395241:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 224 00000100:00100000:1.0:1782239887.395249:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d1bac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afaefb1a-536b-42a3-a3ff-47200f8611c3+13:2344:x1868813737931392:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:0.0:1782239887.395273:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 43 00000100:00100000:0.0:1782239887.395280:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7e0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f135cc01-3d42-4f2a-80ff-79724f1d3285+5:2344:x1868813737931904:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:1.0:1782239887.395317:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d1bac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afaefb1a-536b-42a3-a3ff-47200f8611c3+13:2344:x1868813737931392:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 67us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239887.395317:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7e0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f135cc01-3d42-4f2a-80ff-79724f1d3285+5:2344:x1868813737931904:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 38us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239887.395326:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 224 00000100:00100000:0.0:1782239887.395326:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 43 00000100:00080000:0.0:1782239887.395386:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782239887.402295:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239887.402874:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737931776 00000100:00100000:3.0:1782239887.402884:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737931776 00000100:00100000:3.0:1782239887.402942:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 44 00000100:00100000:3.0:1782239887.402952:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7e0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f135cc01-3d42-4f2a-80ff-79724f1d3285+5:2344:x1868813737931776:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:3.0:1782239887.403025:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7e0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f135cc01-3d42-4f2a-80ff-79724f1d3285+5:2344:x1868813737931776:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 75us (740us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239887.403034:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 44 00000100:00080000:3.0:1782239887.403056:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782239887.404872:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737931648 00000100:00100000:2.0:1782239887.404885:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737931648 00000100:00100000:3.0:1782239887.405100:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737931520 00000100:00100000:3.0:1782239887.405105:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737931520 00000100:00100000:3.0:1782239887.405135:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 77 00000100:00100000:3.0:1782239887.405144:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7e0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f135cc01-3d42-4f2a-80ff-79724f1d3285+5:2344:x1868813737931648:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:1.0:1782239887.405178:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 78 00000100:00100000:1.0:1782239887.405203:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7e0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+6:2344:x1868813737931520:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:3.0:1782239887.405214:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7e0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f135cc01-3d42-4f2a-80ff-79724f1d3285+5:2344:x1868813737931648:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 69us (10152us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239887.405222:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 77 00000100:00100000:1.0:1782239887.405253:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7e0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+6:2344:x1868813737931520:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 53us (10075us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239887.405262:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 78 00000100:00080000:2.0:1782239887.405335:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1782239887.583874:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782239887.647261:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5eddf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1868813758937472:0@lo:400:kworker.0 00000100:00100000:3.0:1782239887.647332:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239887.647400:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5eddf7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1868813758937600:0@lo:400:kworker.0 00000100:00100000:3.0:1782239887.647403:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5eddf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813758937984:0@lo:400:kworker.0 00000100:00100000:3.0:1782239887.647428:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239887.647428:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239887.647454:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782239887.647459:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5eddf6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813758937728:0@lo:400:kworker.0 00000100:00100000:3.0:1782239887.647460:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1782239887.647465:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5eddf4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3305:1868813758937344:0@lo:400:kworker.0 00000100:00100000:1.0:1782239887.647478:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239887.647504:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239887.647504:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758937472 00000100:00100000:1.0:1782239887.647511:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758937472 00000100:00100000:3.0:1782239887.647523:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5eddf5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1868813758937856:0@lo:400:kworker.0 00000100:00100000:3.0:1782239887.647543:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239887.647558:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758937600 00000100:00100000:1.0:1782239887.647561:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758937600 00000100:00100000:3.0:1782239887.647579:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758937344 00000100:00100000:3.0:1782239887.647583:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758937344 00000100:00100000:1.0:1782239887.647591:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758937856 00000100:00100000:1.0:1782239887.647593:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758937856 00000100:00100000:3.0:1782239887.647609:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1782239887.647609:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1782239887.647617:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d1bacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:3305:x1868813758937344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782239887.647617:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7e0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1868813758937472:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1782239887.647698:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782239887.647723:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758937984 00000100:00100000:2.0:1782239887.647727:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758937984 00000100:00100000:2.0:1782239887.647777:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758937728 00000100:00100000:2.0:1782239887.647781:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758937728 00000100:00100000:2.0:1782239887.647799:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1782239887.647805:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7e0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1868813758937984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782239887.647930:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7e0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1868813758937472:12345-0@lo:400:kworker.0 Request processed in 312us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239887.647938:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1782239887.647956:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1782239887.647963:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f780c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1868813758937600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782239887.649306:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1782239887.649324:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f780c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1868813758937728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782239887.652151:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7e0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1868813758937984:12345-0@lo:400:kworker.0 Request processed in 4326us (4702us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239887.652171:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:2.0:1782239887.652215:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782239887.652236:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1782239887.652251:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7e0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1868813758937856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782239887.652312:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7e0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1868813758937856:12345-0@lo:400:kworker.0 Request processed in 69us (4768us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239887.652318:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1782239887.652383:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5eddf4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3305:1868813758937344:0@lo:400:kworker.0 00000100:00100000:2.0:1782239887.652398:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5eddf5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1868813758937856:0@lo:400:kworker.0 00010000:00080000:2.0:1782239887.652410:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb5eddf7800 x1868813758937984/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782239903 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782239887.652434:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5eddf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813758937984:0@lo:400:kworker.0 00000100:00100000:2.0:1782239887.652447:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5eddf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1868813758937472:0@lo:400:kworker.0 00000100:00100000:1.0:1782239887.655742:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f780c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1868813758937600:12345-0@lo:400:kworker.0 Request processed in 7770us (8303us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239887.655772:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1782239887.656060:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5eddf7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1868813758937600:0@lo:400:kworker.0 00000100:00100000:3.0:1782239887.656304:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d1bacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:3305:x1868813758937344:12345-0@lo:400:kworker.0 Request processed in 8686us (8796us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239887.656314:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1782239887.656648:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f780c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1868813758937728:12345-0@lo:400:kworker.0 Request processed in 7331us (9166us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239887.656678:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:1.0:1782239887.656938:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb5eddf6680 x1868813758937728/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782239903 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782239887.656958:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5eddf6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813758937728:0@lo:400:kworker.0 00000100:00100000:0.0:1782239888.159049:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5eddf4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813758938112:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782239888.159119:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239888.159190:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758938112 00000100:00100000:0.0:1782239888.159198:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758938112 00000100:00100000:0.0:1782239888.159241:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1782239888.159250:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5eddf5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1868813758938112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782239888.159285:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782239888.159328:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5eddf5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1868813758938112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239888.159336:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:0.0:1782239888.159380:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb5eddf4000 x1868813758938112/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782239904 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782239888.159399:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5eddf4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813758938112:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782239888.606890:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782239889.636302:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782239890.655068:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782239891.685318:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782239891.743609:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f77f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1868813758938240:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782239891.743707:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239891.747080:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758938240 00000100:00100000:0.0:1782239891.747101:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758938240 00000100:00080000:2.0:1782239891.747413:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782239891.748958:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1782239891.748980:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f77f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1868813758938240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782239891.749029:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782239891.749126:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f77f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1868813758938240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 155us (5420us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239891.749134:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:2.0:1782239891.753419:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb5f77f0a80 x1868813758938240/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782239907 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782239891.753452:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f77f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1868813758938240:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782239892.499881:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239892.499936:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239892.499968:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239892.499995:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239892.500028:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737932288 00000100:00100000:1.0:1782239892.500041:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737932288 00000100:00100000:1.0:1782239892.500112:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737932160 00000100:00100000:1.0:1782239892.500115:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737932160 00000100:00100000:1.0:1782239892.500141:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 82 00000100:00100000:1.0:1782239892.500152:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f780fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f135cc01-3d42-4f2a-80ff-79724f1d3285+5:2345:x1868813737932288:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:1.0:1782239892.500254:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f780fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f135cc01-3d42-4f2a-80ff-79724f1d3285+5:2345:x1868813737932288:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 103us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239892.500264:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 82 00000100:00100000:1.0:1782239892.500285:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 83 00000100:00100000:1.0:1782239892.500292:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f780ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+6:2345:x1868813737932160:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:1.0:1782239892.500322:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f780ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+6:2345:x1868813737932160:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 31us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239892.500329:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 83 00000100:00100000:1.0:1782239892.500349:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737932544 00000100:00100000:1.0:1782239892.500353:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737932544 00000100:00100000:1.0:1782239892.500382:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 47 00000100:00100000:1.0:1782239892.500389:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f780ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f135cc01-3d42-4f2a-80ff-79724f1d3285+5:2345:x1868813737932544:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:1.0:1782239892.500415:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f780ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f135cc01-3d42-4f2a-80ff-79724f1d3285+5:2345:x1868813737932544:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 26us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239892.500440:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 47 00000100:00080000:1.0:1782239892.500462:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782239892.500469:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782239892.501079:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737932032 00000100:00100000:3.0:1782239892.501087:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737932032 00000100:00100000:3.0:1782239892.501146:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 226 00000100:00100000:3.0:1782239892.501155:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d1bac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afaefb1a-536b-42a3-a3ff-47200f8611c3+13:2345:x1868813737932032:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:3.0:1782239892.501207:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d1bac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afaefb1a-536b-42a3-a3ff-47200f8611c3+13:2345:x1868813737932032:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 53us (1342us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239892.501215:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 226 00000100:00100000:1.0:1782239892.506325:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239892.506645:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737932416 00000100:00100000:3.0:1782239892.506658:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737932416 00000100:00100000:3.0:1782239892.506776:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 48 00000100:00100000:3.0:1782239892.506789:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb60135ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f135cc01-3d42-4f2a-80ff-79724f1d3285+5:2345:x1868813737932416:12345-192.168.203.32@tcp:400:kworker.0 00000100:00080000:1.0:1782239892.506899:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782239892.507113:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb60135ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f135cc01-3d42-4f2a-80ff-79724f1d3285+5:2345:x1868813737932416:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 325us (801us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239892.507136:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 48 00010000:00010000:2.0:1782239892.709430:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782239892.770125:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb60135aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1868813758938496:0@lo:400:kworker.0 00000100:00100000:1.0:1782239892.770511:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239892.770593:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5c513e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813758939008:0@lo:400:kworker.0 00000100:00100000:1.0:1782239892.770629:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239892.770667:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1782239892.770675:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb60135b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3305:1868813758938368:0@lo:400:kworker.0 00000100:00100000:1.0:1782239892.770707:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239892.770733:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5c513c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1868813758938880:0@lo:400:kworker.0 00000100:00100000:1.0:1782239892.770783:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239892.772338:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb601359180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1868813758938624:0@lo:400:kworker.0 00000100:00100000:1.0:1782239892.772422:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239892.772475:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782239892.772482:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb601359c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813758938752:0@lo:400:kworker.0 00000100:00100000:1.0:1782239892.772508:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239892.772570:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758938496 00000100:00100000:1.0:1782239892.772579:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758938496 00000100:00100000:1.0:1782239892.772635:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758938880 00000100:00100000:1.0:1782239892.772639:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758938880 00000100:00100000:1.0:1782239892.772665:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758938624 00000100:00100000:1.0:1782239892.772667:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758938624 00000100:00100000:1.0:1782239892.772687:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1782239892.772696:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5c513d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1868813758938496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782239892.772800:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5c513d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1868813758938496:12345-0@lo:400:kworker.0 Request processed in 103us (2290us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239892.773020:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1782239892.773033:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5c513fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1868813758938880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782239892.773076:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5c513fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1868813758938880:12345-0@lo:400:kworker.0 Request processed in 48us (2293us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239892.773090:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1782239892.773112:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1782239892.773118:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5c513f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1868813758938624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782239892.773154:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5c513f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1868813758938624:12345-0@lo:400:kworker.0 Request processed in 36us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239892.773160:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1782239892.773204:0:8312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758939008 00000100:00100000:3.0:1782239892.773210:0:8312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758939008 00000100:00100000:3.0:1782239892.773254:0:8312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758938752 00000100:00100000:3.0:1782239892.773258:0:8312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758938752 00000100:00100000:3.0:1782239892.773281:0:8312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1782239892.773288:0:8312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5c513ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1868813758939008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782239892.773327:0:8312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5c513ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1868813758939008:12345-0@lo:400:kworker.0 Request processed in 40us (2698us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239892.773333:0:8312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1782239892.773345:0:8312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1782239892.773352:0:8312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5c513e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1868813758938752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782239892.773378:0:8312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5c513e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1868813758938752:12345-0@lo:400:kworker.0 Request processed in 27us (869us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239892.773384:0:8312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1782239892.773842:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758938368 00000100:00100000:0.0:1782239892.773848:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758938368 00000100:00100000:0.0:1782239892.773883:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1782239892.773891:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d1bafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:3305:x1868813758938368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782239892.773932:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d1bafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:3305:x1868813758938368:12345-0@lo:400:kworker.0 Request processed in 43us (3224us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239892.773939:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1782239892.774145:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:1.0:1782239892.774171:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782239892.774178:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1782239892.774446:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb601359c00 x1868813758938752/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782239908 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782239892.774463:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb601359c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813758938752:0@lo:400:kworker.0 00000100:00100000:1.0:1782239892.774478:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb601359180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1868813758938624:0@lo:400:kworker.0 00000100:00100000:1.0:1782239892.774520:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb60135b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3305:1868813758938368:0@lo:400:kworker.0 00000100:00100000:1.0:1782239892.774542:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5c513c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1868813758938880:0@lo:400:kworker.0 00000100:00100000:1.0:1782239892.774557:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb60135aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1868813758938496:0@lo:400:kworker.0 00010000:00080000:1.0:1782239892.774571:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb5c513e300 x1868813758939008/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782239908 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782239892.774581:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5c513e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813758939008:0@lo:400:kworker.0 00000100:00100000:2.0:1782239893.281421:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782239893.281450:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f77f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1868813758939136:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782239893.281567:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239893.281646:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758939136 00000100:00100000:2.0:1782239893.281655:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758939136 00000100:00100000:2.0:1782239893.281715:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1782239893.281727:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f77f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1868813758939136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782239893.281811:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782239893.281861:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f77f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1868813758939136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 136us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239893.281869:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:2.0:1782239893.282032:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb5f77f0a80 x1868813758939136/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782239909 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782239893.282062:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f77f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1868813758939136:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782239893.727306:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782239894.751307:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782239895.783050:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782239896.799536:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782239896.863236:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5c513e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1868813758939264:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782239896.863551:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239896.863883:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758939264 00000100:00100000:0.0:1782239896.863896:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758939264 00000100:00100000:0.0:1782239896.863973:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1782239896.863985:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5c513c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1868813758939264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782239896.864038:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1782239896.864152:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782239896.864777:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5c513c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1868813758939264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 790us (1223us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239896.864788:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:1.0:1782239896.864813:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb5c513e300 x1868813758939264/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782239912 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782239896.865045:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5c513e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1868813758939264:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782239897.622541:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239897.622710:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737932672 00000100:00100000:1.0:1782239897.622732:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737932672 00000100:00100000:1.0:1782239897.622898:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 228 00000100:00100000:1.0:1782239897.622920:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d1baf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afaefb1a-536b-42a3-a3ff-47200f8611c3+13:2344:x1868813737932672:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:1.0:1782239897.623012:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d1baf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afaefb1a-536b-42a3-a3ff-47200f8611c3+13:2344:x1868813737932672:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 103us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239897.623020:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 228 00000100:00100000:2.0:1782239897.627932:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239897.627974:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239897.627998:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239897.628089:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239897.628128:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737932800 00000100:00100000:2.0:1782239897.628142:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737932800 00000100:00100000:2.0:1782239897.628213:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737932928 00000100:00100000:2.0:1782239897.628216:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737932928 00000100:00100000:2.0:1782239897.628243:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 87 00000100:00100000:2.0:1782239897.628254:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f77f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+6:2345:x1868813737932800:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:2.0:1782239897.629900:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f77f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+6:2345:x1868813737932800:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 1634us (1969us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239897.629917:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 87 00000100:00100000:2.0:1782239897.629956:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 88 00000100:00100000:2.0:1782239897.629970:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f77f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f135cc01-3d42-4f2a-80ff-79724f1d3285+5:2344:x1868813737932928:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:2.0:1782239897.630038:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f77f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f135cc01-3d42-4f2a-80ff-79724f1d3285+5:2344:x1868813737932928:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 76us (2064us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239897.630045:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 88 00000100:00100000:2.0:1782239897.630074:0:8312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737933056 00000100:00100000:2.0:1782239897.630082:0:8312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737933056 00000100:00100000:2.0:1782239897.630130:0:8312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737933184 00000100:00100000:2.0:1782239897.630133:0:8312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737933184 00000100:00100000:2.0:1782239897.630156:0:8312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 14 00000100:00100000:2.0:1782239897.630181:0:8312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f77f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f135cc01-3d42-4f2a-80ff-79724f1d3285+5:2343:x1868813737933056:12345-192.168.203.32@tcp:9:kworker.0 00000020:00000080:2.0:1782239897.630212:0:8312:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8c5345f1c1ec4d4a 00000100:00080000:2.0:1782239897.630224:0:8312:0:(import.c:65:import_set_state_nolock()) ffff9bb5d819c000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1782239897.630276:0:8312:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00080000:1.0:1782239897.633985:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782239897.633998:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782239897.634003:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782239897.635965:0:8312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f77f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f135cc01-3d42-4f2a-80ff-79724f1d3285+2:2343:x1868813737933056:12345-192.168.203.32@tcp:9:kworker.0 Request processed in 5769us (7948us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239897.635983:0:8312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 14 00000100:00100000:2.0:1782239897.636021:0:8312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 15 00000100:00100000:2.0:1782239897.636034:0:8312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f77f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f135cc01-3d42-4f2a-80ff-79724f1d3285+5:2343:x1868813737933184:12345-192.168.203.32@tcp:9:kworker.0 00000020:00000080:2.0:1782239897.636072:0:8312:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8c5345f1c1ec4d51 00000100:00080000:2.0:1782239897.636086:0:8312:0:(import.c:65:import_set_state_nolock()) ffff9bb5f7cde800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1782239897.636143:0:8312:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1782239897.636369:0:8312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f77f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f135cc01-3d42-4f2a-80ff-79724f1d3285+2:2343:x1868813737933184:12345-192.168.203.32@tcp:9:kworker.0 Request processed in 339us (8278us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239897.636376:0:8312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 15 00010000:00010000:2.0:1782239897.636431:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782239897.638205:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782239897.824809:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782239897.887181:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5c513c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1868813758939776:0@lo:400:kworker.0 00000100:00100000:0.0:1782239897.887992:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5c513f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1868813758939648:0@lo:400:kworker.0 00000100:00100000:0.0:1782239897.888065:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239897.888178:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758939648 00000100:00100000:0.0:1782239897.888206:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758939648 00000100:00100000:2.0:1782239897.888385:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5c513dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1868813758939520:0@lo:400:kworker.0 00000100:00100000:2.0:1782239897.888422:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239897.888448:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5c513ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813758940032:0@lo:400:kworker.0 00000100:00100000:2.0:1782239897.888474:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239897.888510:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1782239897.888518:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5c513e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3305:1868813758939392:0@lo:400:kworker.0 00000100:00100000:2.0:1782239897.888552:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239897.888576:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5c513d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1868813758939904:0@lo:400:kworker.0 00000100:00100000:2.0:1782239897.888610:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239897.888639:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758939520 00000100:00100000:2.0:1782239897.888643:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758939520 00000100:00100000:2.0:1782239897.888670:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758939904 00000100:00100000:2.0:1782239897.888674:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758939904 00000100:00100000:2.0:1782239897.888695:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1782239897.888705:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5eddf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1868813758939648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782239897.888891:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758939392 00000100:00100000:3.0:1782239897.888896:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758939392 00000100:00100000:3.0:1782239897.888934:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1782239897.888942:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d1bae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:3305:x1868813758939392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782239897.889002:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d1bae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:3305:x1868813758939392:12345-0@lo:400:kworker.0 Request processed in 61us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239897.889010:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1782239897.889070:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5c513e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3305:1868813758939392:0@lo:400:kworker.0 00000100:00100000:3.0:1782239897.889122:0:8312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758940032 00000100:00100000:3.0:1782239897.889135:0:8312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758940032 00000100:00100000:3.0:1782239897.889169:0:8312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1782239897.889176:0:8312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f77f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1868813758940032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782239897.889215:0:8312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f77f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1868813758940032:12345-0@lo:400:kworker.0 Request processed in 40us (740us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239897.889221:0:8312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:3.0:1782239897.889256:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb5c513ed80 x1868813758940032/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782239913 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782239897.889270:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5c513ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813758940032:0@lo:400:kworker.0 00000100:00100000:1.0:1782239897.889617:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239897.889946:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1782239897.889960:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f77f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1868813758939520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782239897.890015:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f77f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1868813758939520:12345-0@lo:400:kworker.0 Request processed in 60us (1592us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239897.890022:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1782239897.890037:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1782239897.890045:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f77f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1868813758939904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782239897.891829:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5eddf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1868813758939648:12345-0@lo:400:kworker.0 Request processed in 3111us (3761us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239897.891846:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1782239897.891915:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758939776 00000100:00100000:2.0:1782239897.891925:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758939776 00000100:00100000:2.0:1782239897.891982:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1782239897.891991:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5c513df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1868813758939776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782239897.892049:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5c513df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1868813758939776:12345-0@lo:400:kworker.0 Request processed in 59us (2432us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239897.892056:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:2.0:1782239897.892106:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb5c513c000 x1868813758939776/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782239913 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782239897.892124:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5c513c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1868813758939776:0@lo:400:kworker.0 00000100:00100000:0.0:1782239897.892257:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f77f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1868813758939904:12345-0@lo:400:kworker.0 Request processed in 2212us (3644us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239897.892267:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:0.0:1782239897.892291:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782239897.892301:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782239897.892418:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5c513d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1868813758939904:0@lo:400:kworker.0 00000100:00100000:3.0:1782239897.892435:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5c513dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1868813758939520:0@lo:400:kworker.0 00000100:00100000:1.0:1782239897.892693:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5c513f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1868813758939648:0@lo:400:kworker.0 00000100:00100000:2.0:1782239898.403404:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f77f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813758940160:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782239898.403538:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239898.403633:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758940160 00000100:00100000:2.0:1782239898.403643:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758940160 00000100:00100000:2.0:1782239898.403711:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1782239898.403722:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f77f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1868813758940160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782239898.403801:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782239898.404114:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f77f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1868813758940160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 392us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239898.404123:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:2.0:1782239898.404193:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb5f77f0000 x1868813758940160/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782239914 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782239898.404223:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f77f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813758940160:0@lo:13:osp-pre-1-0.0 00000001:00100000:3.0:1782239898.487319:0:7493:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f135cc01-3d42-4f2a-80ff-79724f1d3285 00000020:00000080:3.0:1782239898.487333:0:7493:0:(genops.c:906:class_export_put()) final put ffff9bb5f7cd9000/f135cc01-3d42-4f2a-80ff-79724f1d3285 00000020:00000080:1.0:1782239898.487425:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9bb5f7cd9000/f135cc01-3d42-4f2a-80ff-79724f1d3285 for lustre-OST0001 00000020:00000080:1.0:1782239898.487489:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9bb5f7cde800 for lustre-OST0001 00010000:00010000:1.0:1782239898.853649:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782239899.871347:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1782239900.564062:0:6614:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f135cc01-3d42-4f2a-80ff-79724f1d3285 00000020:00000080:2.0:1782239900.564088:0:6614:0:(genops.c:906:class_export_put()) final put ffff9bb5d819f800/f135cc01-3d42-4f2a-80ff-79724f1d3285 00000020:00000080:0.0:1782239900.564308:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9bb5d819f800/f135cc01-3d42-4f2a-80ff-79724f1d3285 for lustre-OST0000 00000020:00000080:0.0:1782239900.564376:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9bb5d819c000 for lustre-OST0000 00010000:00010000:3.0:1782239900.894954:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782239901.919134:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782239901.971393:0:10870:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:0.0:1782239901.988156:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f77f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1868813758940288:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782239901.988274:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239901.988479:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758940288 00000100:00100000:3.0:1782239901.988492:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758940288 00000100:00100000:3.0:1782239901.988584:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1782239901.988598:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5eddf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1868813758940288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782239901.988655:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1782239901.988869:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782239901.996923:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5eddf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1868813758940288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 8315us (8635us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239901.996942:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:0.0:1782239901.999737:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb5f77f0000 x1868813758940288/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782239917 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782239901.999798:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f77f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1868813758940288:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782239902.742966:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239902.743030:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239902.743136:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239902.743179:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737933440 00000100:00100000:2.0:1782239902.743192:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737933440 00000100:00100000:2.0:1782239902.743276:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737933568 00000100:00100000:2.0:1782239902.743279:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737933568 00000100:00100000:2.0:1782239902.743312:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 92 00000100:00100000:2.0:1782239902.743324:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f77f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+6:2346:x1868813737933440:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:2.0:1782239902.743431:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f77f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+6:2346:x1868813737933440:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 109us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239902.743440:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 92 00000100:00100000:2.0:1782239902.743471:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 93 00000100:00100000:2.0:1782239902.743479:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f77f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f135cc01-3d42-4f2a-80ff-79724f1d3285+5:2347:x1868813737933568:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:2.0:1782239902.743530:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f77f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f135cc01-3d42-4f2a-80ff-79724f1d3285+5:2347:x1868813737933568:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 51us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239902.743538:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 93 00000100:00080000:2.0:1782239902.743560:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782239902.743936:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737933312 00000100:00100000:3.0:1782239902.743943:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737933312 00000100:00100000:3.0:1782239902.744000:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 230 00000100:00100000:3.0:1782239902.744017:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d1baf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afaefb1a-536b-42a3-a3ff-47200f8611c3+13:2347:x1868813737933312:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:3.0:1782239902.744064:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d1baf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afaefb1a-536b-42a3-a3ff-47200f8611c3+13:2347:x1868813737933312:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 49us (1034us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239902.744070:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 230 00010000:00010000:3.0:1782239902.942961:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782239903.007886:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5c513f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1868813758940672:0@lo:400:kworker.0 00000100:00100000:1.0:1782239903.007989:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239903.008062:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782239903.008069:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5c513ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813758940800:0@lo:400:kworker.0 00000100:00100000:1.0:1782239903.008100:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239903.008139:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758940672 00000100:00100000:1.0:1782239903.008148:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758940672 00000100:00100000:1.0:1782239903.008215:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1782239903.008228:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5c513dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1868813758940672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782239903.008429:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5c513d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1868813758940544:0@lo:400:kworker.0 00000100:00100000:3.0:1782239903.008477:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239903.008502:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5c513ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813758941056:0@lo:400:kworker.0 00000100:00100000:3.0:1782239903.008525:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239903.008550:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1782239903.008557:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5c513f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3305:1868813758940416:0@lo:400:kworker.0 00000100:00100000:3.0:1782239903.008589:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239903.008611:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5c513c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1868813758940928:0@lo:400:kworker.0 00000100:00100000:3.0:1782239903.008634:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239903.008663:0:8312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758940800 00000100:00100000:3.0:1782239903.008668:0:8312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758940800 00000100:00100000:3.0:1782239903.008701:0:8312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758941056 00000100:00100000:3.0:1782239903.008705:0:8312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758941056 00000100:00100000:3.0:1782239903.008728:0:8312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1782239903.008735:0:8312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5c513d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1868813758940800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782239903.008826:0:8312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5c513d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1868813758940800:12345-0@lo:400:kworker.0 Request processed in 91us (724us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239903.008836:0:8312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1782239903.008855:0:8312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1782239903.008861:0:8312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7e0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1868813758941056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782239903.008913:0:8312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7e0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1868813758941056:12345-0@lo:400:kworker.0 Request processed in 53us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239903.008920:0:8312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1782239903.008939:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758940544 00000100:00100000:3.0:1782239903.008942:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758940544 00000100:00100000:3.0:1782239903.008956:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758940928 00000100:00100000:3.0:1782239903.008958:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758940928 00000100:00100000:3.0:1782239903.008975:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1782239903.008981:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7e0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1868813758940544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782239903.009012:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7e0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1868813758940544:12345-0@lo:400:kworker.0 Request processed in 30us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239903.009018:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1782239903.009029:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1782239903.009035:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7e0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1868813758940928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782239903.009062:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7e0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1868813758940928:12345-0@lo:400:kworker.0 Request processed in 28us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239903.009067:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1782239903.009088:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758940416 00000100:00100000:3.0:1782239903.009091:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758940416 00000100:00100000:3.0:1782239903.009115:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1782239903.009121:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d1bae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:3305:x1868813758940416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782239903.009152:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d1bae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:3305:x1868813758940416:12345-0@lo:400:kworker.0 Request processed in 31us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239903.009159:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1782239903.009224:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5c513f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3305:1868813758940416:0@lo:400:kworker.0 00000100:00100000:3.0:1782239903.009258:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5c513c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1868813758940928:0@lo:400:kworker.0 00000100:00100000:3.0:1782239903.009278:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5c513d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1868813758940544:0@lo:400:kworker.0 00010000:00080000:3.0:1782239903.009292:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb5c513ca80 x1868813758941056/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782239919 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782239903.009303:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5c513ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813758941056:0@lo:400:kworker.0 00010000:00080000:3.0:1782239903.009343:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb5c513ea00 x1868813758940800/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782239919 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782239903.009353:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5c513ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813758940800:0@lo:400:kworker.0 00000100:00100000:1.0:1782239903.010544:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5c513dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1868813758940672:12345-0@lo:400:kworker.0 Request processed in 2315us (2552us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239903.010564:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:1.0:1782239903.010601:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782239903.010608:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782239903.010611:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782239903.015549:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5c513f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1868813758940672:0@lo:400:kworker.0 00000100:00100000:0.0:1782239903.521630:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782239903.521661:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5eddf5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1868813758941184:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782239903.521806:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239903.521965:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758941184 00000100:00100000:2.0:1782239903.521976:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758941184 00000100:00100000:2.0:1782239903.522046:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1782239903.522057:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5eddf5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1868813758941184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782239903.522107:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782239903.522170:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5eddf5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1868813758941184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239903.522178:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:2.0:1782239903.522232:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb5eddf5f80 x1868813758941184/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782239919 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782239903.522253:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5eddf5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1868813758941184:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782239903.966894:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782239904.991738:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782239906.015018:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782239906.077106:0:11018:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdfc102e20 20000000:00000080:1.0:1782239906.077125:0:11018:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9bb5f7c8f400 uarg=0000000000000000 20000000:01000000:1.0:1782239906.077161:0:11018:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1782239906.077167:0:11018:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1782239906.077172:0:11018:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1782239906.078176:0:11019:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1782239906.078377:0:11018:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1782239906.085318:0:11018:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1782239906.085355:0:11018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bb5c1676400/0x8c5345f1c1ec4d58 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239906.085376:0:11018:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bb5ee29e000/0x8c5345f1c1ec4cfd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e3ea expref: 12 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239906.085385:0:11018:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bb5c2a45600/0x8c5345f1c1ec4d0b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4d04 expref: 18 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239906.085391:0:11018:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bb5c1677000/0x8c5345f1c1ec4d19 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4d12 expref: 18 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239906.085398:0:11018:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bb5c0030800/0x8c5345f1c1ec4d27 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4d20 expref: 18 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239906.085404:0:11018:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bb5c2a44200/0x8c5345f1c1ec4d3c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e422 expref: 12 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239906.085412:0:11018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bb5c1676400/0x8c5345f1c1ec4d58 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239906.085479:0:11018:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bb5c2a44200/0x8c5345f1c1ec4d3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e422 expref: 12 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239906.085496:0:11018:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bb5c2a44200/0x8c5345f1c1ec4d3c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e422 expref: 12 pid: 5783 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239906.085511:0:11018:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5c513ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11018:1868813758941312:192.168.203.32@tcp:104: 00010000:00010000:1.0:1782239906.085733:0:11018:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bb5c0030800/0x8c5345f1c1ec4d27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8c5345f1c1ec4d20 expref: 18 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239906.085742:0:11018:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bb5c0030800/0x8c5345f1c1ec4d27 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8c5345f1c1ec4d20 expref: 18 pid: 5785 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239906.085796:0:11018:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5c513c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11018:1868813758941440:0@lo:104: 00000100:00100000:1.0:1782239906.085837:0:11018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239906.086293:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758941440 00000100:00100000:0.0:1782239906.086302:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758941440 00000100:00100000:0.0:1782239906.086398:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1782239906.086409:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5c513e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+3:11018:x1868813758941440:12345-0@lo:104: 00010000:00010000:0.0:1782239906.086422:0:5773:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.132@tcp lock: ffff9bb5c0030a00/0x8c5345f1c1ec4d20 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c5345f1c1ec4d27 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239906.086487:0:5773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782239906.086493:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5c513e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+3:11018:x1868813758941440:12345-0@lo:104: Request processed in 87us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239906.086501:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:1.0:1782239906.086563:0:11018:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bb5c1677000/0x8c5345f1c1ec4d19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8c5345f1c1ec4d12 expref: 18 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239906.086572:0:11018:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bb5c1677000/0x8c5345f1c1ec4d19 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8c5345f1c1ec4d12 expref: 18 pid: 5785 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239906.086582:0:11018:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5c513f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11018:1868813758941568:0@lo:104: 00000100:00100000:1.0:1782239906.086607:0:11018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782239906.086785:0:11018:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bb5c2a45600/0x8c5345f1c1ec4d0b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8c5345f1c1ec4d04 expref: 18 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239906.086794:0:11018:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bb5c2a45600/0x8c5345f1c1ec4d0b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8c5345f1c1ec4d04 expref: 18 pid: 5784 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239906.086819:0:11018:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5c513ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11018:1868813758941696:0@lo:104: 00000100:00100000:1.0:1782239906.086845:0:11018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239906.086932:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758941568 00000100:00100000:3.0:1782239906.086937:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758941568 00000100:00100000:3.0:1782239906.086962:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1782239906.086969:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5c513ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+3:11018:x1868813758941568:12345-0@lo:104: 00010000:00010000:3.0:1782239906.086978:0:5774:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a45e00/0x8c5345f1c1ec4d12 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c5345f1c1ec4d19 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239906.087019:0:5774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1782239906.087024:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5c513ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+3:11018:x1868813758941568:12345-0@lo:104: Request processed in 57us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239906.087030:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:3.0:1782239906.087047:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782239906.087052:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.132@tcp lock: ffff9bb5c0030a00/0x8c5345f1c1ec4d20 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c5345f1c1ec4d27 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239906.087070:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5c0030a00 already unused, calling callback (ffffffffc1d0cc20) 10000000:00010000:3.0:1782239906.087074:0:5779:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.132@tcp lock: ffff9bb5c0030a00/0x8c5345f1c1ec4d20 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8c5345f1c1ec4d27 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239906.087082:0:5779:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.132@tcp lock: ffff9bb5c0030a00/0x8c5345f1c1ec4d20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8c5345f1c1ec4d27 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782239906.087089:0:5779:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.132@tcp lock: ffff9bb5c0030a00/0x8c5345f1c1ec4d20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8c5345f1c1ec4d27 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782239906.087095:0:5779:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1782239906.087124:0:5779:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.132@tcp lock: ffff9bb5c0030a00/0x8c5345f1c1ec4d20 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c5345f1c1ec4d27 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239906.087130:0:5779:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782239906.087149:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.132@tcp lock: ffff9bb5c0030a00/0x8c5345f1c1ec4d20 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c5345f1c1ec4d27 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239906.087156:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.132@tcp lock: ffff9bb5c0030a00/0x8c5345f1c1ec4d20 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c5345f1c1ec4d27 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239906.087169:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782239906.087172:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a45e00/0x8c5345f1c1ec4d12 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c5345f1c1ec4d19 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239906.087177:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5c2a45e00 already unused, calling callback (ffffffffc1d0cc20) 10000000:00010000:3.0:1782239906.087180:0:5779:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a45e00/0x8c5345f1c1ec4d12 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8c5345f1c1ec4d19 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239906.087196:0:5779:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a45e00/0x8c5345f1c1ec4d12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8c5345f1c1ec4d19 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782239906.087203:0:5779:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a45e00/0x8c5345f1c1ec4d12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8c5345f1c1ec4d19 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782239906.087208:0:5779:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1782239906.087221:0:5779:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a45e00/0x8c5345f1c1ec4d12 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c5345f1c1ec4d19 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239906.087227:0:5779:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782239906.087242:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a45e00/0x8c5345f1c1ec4d12 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c5345f1c1ec4d19 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239906.087248:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a45e00/0x8c5345f1c1ec4d12 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c5345f1c1ec4d19 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239906.087258:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782239906.087260:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782239906.087262:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782239906.087267:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782239906.087273:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782239906.087284:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f7e0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3305:1868813758941952:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782239906.087314:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239906.087347:0:7481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758941952 00000100:00100000:3.0:1782239906.087351:0:7481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758941952 00010000:00010000:3.0:1782239906.087367:0:7481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bb5c1677000/0x8c5345f1c1ec4d19 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c5345f1c1ec4d12 expref: 19 pid: 5785 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239906.087385:0:7481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1782239906.087398:0:7481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d0218050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:3305:x1868813758941952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782239906.087408:0:7481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782239906.087413:0:7481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bb5c1677000/0x8c5345f1c1ec4d19 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c5345f1c1ec4d12 expref: 19 pid: 5785 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239906.087422:0:7481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bb5c1677000/0x8c5345f1c1ec4d19 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8c5345f1c1ec4d12 expref: 19 pid: 5785 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239906.087453:0:7481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782239906.087478:0:7481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d0218050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:3305:x1868813758941952:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239906.087484:0:7481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1782239906.087542:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f7e0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3305:1868813758941952:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782239906.088057:0:11018:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bb5ee29e000/0x8c5345f1c1ec4cfd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e3ea expref: 12 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239906.088068:0:11018:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bb5ee29e000/0x8c5345f1c1ec4cfd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e3ea expref: 12 pid: 5783 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239906.088079:0:11018:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5c513c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11018:1868813758942080:192.168.203.32@tcp:104: 00000100:00100000:2.0:1782239906.088338:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f7e0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3307:1868813758941824:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782239906.089619:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239906.089692:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758941824 00000100:00100000:2.0:1782239906.089699:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758941824 00010000:00010000:2.0:1782239906.089733:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bb5c0030800/0x8c5345f1c1ec4d27 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c5345f1c1ec4d20 expref: 19 pid: 5785 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239906.089779:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1782239906.089788:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f77f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:3307:x1868813758941824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782239906.089803:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782239906.089808:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bb5c0030800/0x8c5345f1c1ec4d27 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c5345f1c1ec4d20 expref: 19 pid: 5785 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239906.089832:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bb5c0030800/0x8c5345f1c1ec4d27 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8c5345f1c1ec4d20 expref: 19 pid: 5785 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239906.089851:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782239906.089889:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f77f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:3307:x1868813758941824:12345-0@lo:103:ldlm_bl.0 Request processed in 102us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239906.089896:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1782239906.089932:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f7e0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3307:1868813758941824:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782239906.090209:0:11018:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c50a63c0 going to sleep for 11 seconds 00010000:00010000:0.0:1782239906.090226:0:11018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb5c0030800/0x8c5345f1c1ec4d27 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8c5345f1c1ec4d20 expref: 18 pid: 5785 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782239906.090237:0:11018:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5c513c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11018:1868813758941440:0@lo:104: 00010000:00010000:0.0:1782239906.090246:0:11018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb5c1677000/0x8c5345f1c1ec4d19 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8c5345f1c1ec4d12 expref: 17 pid: 5785 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782239906.090253:0:11018:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5c513f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11018:1868813758941568:0@lo:104: 00000100:00100000:3.0:1782239906.090426:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758941696 00000100:00100000:3.0:1782239906.090431:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758941696 00000100:00100000:3.0:1782239906.093773:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1782239906.093794:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5c513d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+3:11018:x1868813758941696:12345-0@lo:104: 00010000:00010000:3.0:1782239906.093822:0:5774:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.132@tcp lock: ffff9bb5ee29f600/0x8c5345f1c1ec4d04 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c5345f1c1ec4d0b expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239906.093929:0:5774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782239906.093935:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5c513d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+3:11018:x1868813758941696:12345-0@lo:104: Request processed in 150us (7089us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239906.093942:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1782239906.094120:0:11018:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5c513ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11018:1868813758941696:0@lo:104: 00000100:00100000:1.0:1782239906.094362:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239906.094391:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239906.094413:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737933696 00000100:00100000:1.0:1782239906.094419:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737933696 00010000:00010000:1.0:1782239906.094459:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bb5c2a44200/0x8c5345f1c1ec4d3c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e422 expref: 13 pid: 5783 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239906.094483:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737933824 00000100:00100000:1.0:1782239906.094486:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737933824 00010000:00010000:1.0:1782239906.094498:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bb5ee29e000/0x8c5345f1c1ec4cfd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e3ea expref: 14 pid: 5783 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239906.094516:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 27 00000100:00100000:1.0:1782239906.094523:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5c513f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:afaefb1a-536b-42a3-a3ff-47200f8611c3+14:2346:x1868813737933696:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782239906.094534:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782239906.094539:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bb5c2a44200/0x8c5345f1c1ec4d3c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e422 expref: 14 pid: 5783 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239906.094567:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bb5c2a44200/0x8c5345f1c1ec4d3c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e422 expref: 14 pid: 5783 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239906.094585:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782239906.094729:0:11018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb5c2a44200/0x8c5345f1c1ec4d3c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e422 expref: 14 pid: 5783 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239906.094772:0:11018:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5c513ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11018:1868813758941312:192.168.203.32@tcp:104: 00000100:00100000:2.0:1782239906.094785:0:11018:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5c513c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11018:1868813758942080:192.168.203.32@tcp:104: 00010000:00010000:2.0:1782239906.094825:0:11018:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bb5c1676400/0x8c5345f1c1ec4d58 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239906.095047:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5c513f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:afaefb1a-536b-42a3-a3ff-47200f8611c3+13:2346:x1868813737933696:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 523us (686us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239906.095055:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 27 00000100:00100000:1.0:1782239906.095073:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 28 00000100:00100000:1.0:1782239906.095080:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb60135aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:afaefb1a-536b-42a3-a3ff-47200f8611c3+12:2346:x1868813737933824:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782239906.095089:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782239906.095094:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bb5ee29e000/0x8c5345f1c1ec4cfd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e3ea expref: 12 pid: 5783 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239906.095102:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bb5ee29e000/0x8c5345f1c1ec4cfd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e3ea expref: 12 pid: 5783 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239906.095112:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb5ee29e000/0x8c5345f1c1ec4cfd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e3ea expref: 12 pid: 5783 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239906.095121:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782239906.095140:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb60135aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:afaefb1a-536b-42a3-a3ff-47200f8611c3+11:2346:x1868813737933824:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 61us (749us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239906.095147:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 28 00010000:00010000:2.0:1782239906.095881:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782239906.095888:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.132@tcp lock: ffff9bb5ee29f600/0x8c5345f1c1ec4d04 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c5345f1c1ec4d0b expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239906.095898:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5ee29f600 already unused, calling callback (ffffffffc1d0cc20) 10000000:00010000:2.0:1782239906.095902:0:5779:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.132@tcp lock: ffff9bb5ee29f600/0x8c5345f1c1ec4d04 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8c5345f1c1ec4d0b expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239906.095910:0:5779:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.132@tcp lock: ffff9bb5ee29f600/0x8c5345f1c1ec4d04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8c5345f1c1ec4d0b expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782239906.095926:0:5779:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.132@tcp lock: ffff9bb5ee29f600/0x8c5345f1c1ec4d04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8c5345f1c1ec4d0b expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782239906.095931:0:5779:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1782239906.095974:0:5779:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.132@tcp lock: ffff9bb5ee29f600/0x8c5345f1c1ec4d04 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c5345f1c1ec4d0b expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239906.095980:0:5779:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782239906.096002:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.132@tcp lock: ffff9bb5ee29f600/0x8c5345f1c1ec4d04 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c5345f1c1ec4d0b expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239906.096009:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.132@tcp lock: ffff9bb5ee29f600/0x8c5345f1c1ec4d04 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c5345f1c1ec4d0b expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239906.096025:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782239906.096026:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782239906.096028:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782239906.096035:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782239906.096049:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f77f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3304:1868813758942208:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782239906.096100:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239906.096256:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758942208 00000100:00100000:1.0:1782239906.096262:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758942208 00010000:00010000:1.0:1782239906.096284:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bb5c2a45600/0x8c5345f1c1ec4d0b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c5345f1c1ec4d04 expref: 17 pid: 5784 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239906.096328:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1782239906.096337:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f77f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+17:3304:x1868813758942208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782239906.096348:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782239906.096353:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bb5c2a45600/0x8c5345f1c1ec4d0b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c5345f1c1ec4d04 expref: 17 pid: 5784 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239906.096364:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bb5c2a45600/0x8c5345f1c1ec4d0b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8c5345f1c1ec4d04 expref: 17 pid: 5784 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239906.096376:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb5c2a45600/0x8c5345f1c1ec4d0b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8c5345f1c1ec4d04 expref: 17 pid: 5784 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239906.096389:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bb5c1676400/0x8c5345f1c1ec4d58 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239906.096397:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb5c1676400/0x8c5345f1c1ec4d58 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239906.096413:0:5775:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bb5c1676400/0x8c5345f1c1ec4d58 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239906.096421:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bb5c1676400/0x8c5345f1c1ec4d58 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239906.096428:0:5775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bb5c1676400/0x8c5345f1c1ec4d58 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239906.096447:0:5775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bb5c1676400/0x8c5345f1c1ec4d58 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239906.096464:0:5775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5c1676400 already unused, calling callback (ffffffffc1728ce0) 00010000:00010000:1.0:1782239906.096469:0:5775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bb5c1676400/0x8c5345f1c1ec4d58 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239906.096477:0:5775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bb5c1676400/0x8c5345f1c1ec4d58 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239906.096490:0:5775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bb5c1676400/0x8c5345f1c1ec4d58 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239906.096500:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782239906.096538:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f77f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+16:3304:x1868813758942208:12345-0@lo:103:ldlm_bl.0 Request processed in 203us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239906.096546:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1782239906.096578:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f77f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3304:1868813758942208:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782239906.098982:0:11018:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bb5c1676400/0x8c5345f1c1ec4d58 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239906.099002:0:11018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bb5c1676400/0x8c5345f1c1ec4d58 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239906.099009:0:11018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb5c1676400/0x8c5345f1c1ec4d58 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239907.043683:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782239907.102935:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f77f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813758942336:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782239907.103008:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239907.103104:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758942336 00000100:00100000:1.0:1782239907.103113:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758942336 00000100:00100000:1.0:1782239907.103170:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1782239907.103179:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5eddf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1868813758942336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782239907.103216:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782239907.106698:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5eddf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1868813758942336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3510us (3679us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239907.106714:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:1.0:1782239907.106766:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1782239907.111183:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb5f77f2a00 x1868813758942336/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782239923 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782239907.111210:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f77f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813758942336:0@lo:13:osp-pre-0-0.0 10000000:01000000:1.0:1782239907.486909:0:5787:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1782239907.486915:0:5787:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9bb5eddbf000 from 7 10000000:01000000:1.0:1782239907.486920:0:5787:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1782239907.487531:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5c1676600/0x8c5345f1c1ec4d5f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239907.487549:0:5787:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: ffff9bb5c1676600/0x8c5345f1c1ec4d5f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239907.487562:0:5787:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff9bb5c1676600/0x8c5345f1c1ec4d5f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239907.487585:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb60135b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758942464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782239907.487647:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239907.487700:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c50a6840 going to sleep for 11 seconds 00000100:00100000:3.0:1782239907.487865:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758942464 00000100:00100000:3.0:1782239907.487873:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758942464 00000100:00100000:3.0:1782239907.487925:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1782239907.487943:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5decbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+16:5787:x1868813758942464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782239907.487958:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782239907.487971:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb5c2a45e00/0x8c5345f1c1ec4d66 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c5345f1c1ec4d5f expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239907.487994:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb5c2a45e00/0x8c5345f1c1ec4d66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4d5f expref: 17 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239907.488006:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb5c2a45e00/0x8c5345f1c1ec4d66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4d5f expref: 17 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239907.488015:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5c2a45e00, rc 0) 00000100:00100000:3.0:1782239907.488063:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5decbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+17:5787:x1868813758942464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239907.488070:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1782239907.488153:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb60135b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758942464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782239907.488166:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff9bb5c1676600/0x8c5345f1c1ec4d5f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4d66 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239907.488180:0:5787:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff9bb5c1676600/0x8c5345f1c1ec4d5f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c5345f1c1ec4d66 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782239907.488238:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5eddf6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758942592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782239907.488265:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239907.488294:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5d13420c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782239907.488362:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758942592 00000100:00100000:3.0:1782239907.488366:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758942592 00000100:00100000:3.0:1782239907.488724:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1782239907.488732:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5decbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+17:5787:x1868813758942592:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782239907.492677:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5decbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+17:5787:x1868813758942592:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 3936us (4401us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239907.492691:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1782239907.501996:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5eddf6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758942592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782239907.502201:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb601359180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758942720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782239907.502289:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239907.502336:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c50a6480 going to sleep for 11 seconds 00000100:00100000:2.0:1782239907.502553:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758942720 00000100:00100000:2.0:1782239907.502568:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758942720 00000100:00100000:2.0:1782239907.502629:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1782239907.502640:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5decbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+17:5787:x1868813758942720:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782239907.503577:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5decbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+17:5787:x1868813758942720:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 935us (1284us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239907.503586:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1782239907.504993:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb601359180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758942720:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1782239907.509629:0:11047:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1782239907.510572:0:5787:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1782239907.510604:0:5787:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1782239907.510614:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5c1676600/0x8c5345f1c1ec4d5f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4d66 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239907.510626:0:5787:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff9bb5c1676600/0x8c5345f1c1ec4d5f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4d66 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782239907.510637:0:5787:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1782239907.510639:0:5787:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9bb5c8863000 from 7 10000000:01000000:2.0:1782239907.510642:0:5787:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1782239907.510683:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5ee29e200/0x8c5345f1c1ec4d6d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239907.510692:0:5787:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: ffff9bb5ee29e200/0x8c5345f1c1ec4d6d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239907.510704:0:5787:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff9bb5ee29e200/0x8c5345f1c1ec4d6d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239907.510730:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f77f2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758942848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782239907.510827:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239907.510869:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb601a1c540 going to sleep for 11 seconds 00000100:00100000:3.0:1782239907.511520:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758942848 00000100:00100000:3.0:1782239907.511529:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758942848 00000100:00100000:3.0:1782239907.511576:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1782239907.511584:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5decbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+17:5787:x1868813758942848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782239907.511599:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782239907.511620:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb5c2a44000/0x8c5345f1c1ec4d74 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c5345f1c1ec4d6d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239907.511647:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb5c2a44000/0x8c5345f1c1ec4d74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4d6d expref: 18 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239907.511658:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb5c2a44000/0x8c5345f1c1ec4d74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4d6d expref: 18 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239907.511667:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5c2a44000, rc 0) 00000100:00100000:3.0:1782239907.511724:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5decbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+18:5787:x1868813758942848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (897us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239907.511732:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1782239907.511866:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f77f2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758942848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782239907.511888:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff9bb5ee29e200/0x8c5345f1c1ec4d6d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4d74 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239907.511898:0:5787:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff9bb5ee29e200/0x8c5345f1c1ec4d6d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c5345f1c1ec4d74 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239907.511962:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb601359c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758942976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782239907.511993:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239907.512024:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758942976 00000100:00100000:1.0:1782239907.512029:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758942976 00000100:00100000:1.0:1782239907.512049:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1782239907.512054:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5decbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+18:5787:x1868813758942976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782239907.512421:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5decbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+18:5787:x1868813758942976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 365us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239907.512439:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1782239907.512472:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c50a6600 going to sleep for 11 seconds 00000100:00100000:1.0:1782239907.512484:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb601359c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758942976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782239907.512511:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb601359c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758943104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782239907.512544:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239907.512562:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758943104 00000100:00100000:1.0:1782239907.512565:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758943104 00000100:00100000:1.0:1782239907.512580:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1782239907.512585:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5decbc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+18:5787:x1868813758943104:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782239907.512702:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5decbc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+18:5787:x1868813758943104:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 116us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239907.512709:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1782239907.512738:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c50a6600 going to sleep for 11 seconds 00000100:00100000:1.0:1782239907.514009:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb601359c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758943104:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1782239907.517694:0:11049:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1782239907.517955:0:5787:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1782239907.517980:0:5787:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1782239907.517998:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5ee29e200/0x8c5345f1c1ec4d6d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4d74 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239907.518009:0:5787:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff9bb5ee29e200/0x8c5345f1c1ec4d6d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4d74 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782239907.518018:0:5787:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1782239907.518021:0:5787:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9bb5c8415000 from 7 10000000:01000000:2.0:1782239907.518023:0:5787:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1782239907.518060:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5ee29f600/0x8c5345f1c1ec4d7b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239907.518067:0:5787:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: ffff9bb5ee29f600/0x8c5345f1c1ec4d7b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239907.518078:0:5787:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff9bb5ee29f600/0x8c5345f1c1ec4d7b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239907.518102:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f77f3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758943232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782239907.518168:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239907.518224:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb601a1c0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782239907.518657:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758943232 00000100:00100000:1.0:1782239907.518666:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758943232 00000100:00100000:1.0:1782239907.518723:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1782239907.518733:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5decbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+18:5787:x1868813758943232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782239907.519251:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782239907.519735:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb5c1677c00/0x8c5345f1c1ec4d82 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c5345f1c1ec4d7b expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239907.521441:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb5c1677c00/0x8c5345f1c1ec4d82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4d7b expref: 19 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239907.521458:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb5c1677c00/0x8c5345f1c1ec4d82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4d7b expref: 19 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239907.521467:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5c1677c00, rc 0) 00000100:00100000:0.0:1782239907.521550:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5decbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:5787:x1868813758943232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2818us (3381us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239907.521559:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1782239907.521658:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f77f3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758943232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782239907.521678:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff9bb5ee29f600/0x8c5345f1c1ec4d7b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4d82 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239907.521687:0:5787:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff9bb5ee29f600/0x8c5345f1c1ec4d7b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c5345f1c1ec4d82 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782239907.522466:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb601359c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758943360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782239907.522509:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239907.522548:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5d1342540 going to sleep for 11 seconds 00000100:00100000:3.0:1782239907.522912:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758943360 00000100:00100000:3.0:1782239907.522920:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758943360 00000100:00100000:3.0:1782239907.524386:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1782239907.524403:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5decbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:5787:x1868813758943360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782239907.524718:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5decbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:5787:x1868813758943360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 320us (2207us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239907.524725:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1782239907.524815:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb601359c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758943360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782239907.524862:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5eddf7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758943488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782239907.524910:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239907.532096:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5d1342540 going to sleep for 11 seconds 00000100:00100000:1.0:1782239907.534232:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758943488 00000100:00100000:1.0:1782239907.534245:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758943488 00000100:00100000:0.0:1782239907.534369:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1782239907.534380:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5decbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:5787:x1868813758943488:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782239907.534705:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5decbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:5787:x1868813758943488:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 317us (9784us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239907.534714:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1782239907.535106:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5eddf7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758943488:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1782239907.543184:0:11050:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1782239907.552493:0:5787:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1782239907.552533:0:5787:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1782239907.552545:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5ee29f600/0x8c5345f1c1ec4d7b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4d82 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239907.552560:0:5787:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff9bb5ee29f600/0x8c5345f1c1ec4d7b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4d82 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239907.798116:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239907.798192:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737933952 00000100:00100000:0.0:1782239907.798207:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737933952 00000100:00100000:0.0:1782239907.798290:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 241 00000100:00100000:0.0:1782239907.798303:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5decbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afaefb1a-536b-42a3-a3ff-47200f8611c3+11:5567:x1868813737933952:12345-192.168.203.32@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782239907.798327:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782239907.798351:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb5c0031800/0x8c5345f1c1ec4d89 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e44c expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239907.798475:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb5c0031800/0x8c5345f1c1ec4d89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e44c expref: 12 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239907.798490:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb5c0031800/0x8c5345f1c1ec4d89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e44c expref: 12 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239907.798502:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5c0031800, rc 0) 00000100:00100000:0.0:1782239907.798573:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5decbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afaefb1a-536b-42a3-a3ff-47200f8611c3+12:5567:x1868813737933952:12345-192.168.203.32@tcp:101:ll_cfg_requeue.0 Request processed in 273us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239907.798583:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 241 00000100:00100000:2.0:1782239907.811839:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239907.811924:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737934080 00000100:00100000:0.0:1782239907.811938:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737934080 00000100:00100000:0.0:1782239907.812011:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 242 00000100:00100000:0.0:1782239907.812024:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5decbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afaefb1a-536b-42a3-a3ff-47200f8611c3+12:5567:x1868813737934080:12345-192.168.203.32@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782239907.812719:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5decbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afaefb1a-536b-42a3-a3ff-47200f8611c3+12:5567:x1868813737934080:12345-192.168.203.32@tcp:501:ll_cfg_requeue.0 Request processed in 694us (891us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239907.812738:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 242 00000100:00100000:3.0:1782239907.819491:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239907.823104:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737934208 00000100:00100000:2.0:1782239907.823124:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737934208 00000100:00100000:2.0:1782239907.823207:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 243 00000100:00100000:2.0:1782239907.823219:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5decbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afaefb1a-536b-42a3-a3ff-47200f8611c3+12:5567:x1868813737934208:12345-192.168.203.32@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782239907.823605:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5decbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afaefb1a-536b-42a3-a3ff-47200f8611c3+12:5567:x1868813737934208:12345-192.168.203.32@tcp:503:ll_cfg_requeue.0 Request processed in 387us (4127us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239907.823625:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 243 00000100:00100000:1.0:1782239907.844836:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239907.846571:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737934336 00000100:00100000:2.0:1782239907.846592:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737934336 00000100:00100000:2.0:1782239907.846673:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 244 00000100:00100000:2.0:1782239907.846687:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5decbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afaefb1a-536b-42a3-a3ff-47200f8611c3+12:5567:x1868813737934336:12345-192.168.203.32@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782239907.846712:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782239907.846737:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb5ee29fc00/0x8c5345f1c1ec4d90 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e453 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239907.846799:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb5ee29fc00/0x8c5345f1c1ec4d90 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e453 expref: 13 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239907.846813:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb5ee29fc00/0x8c5345f1c1ec4d90 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e453 expref: 13 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239907.846824:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5ee29fc00, rc 0) 00000100:00100000:2.0:1782239907.846906:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5decbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afaefb1a-536b-42a3-a3ff-47200f8611c3+13:5567:x1868813737934336:12345-192.168.203.32@tcp:101:ll_cfg_requeue.0 Request processed in 222us (2084us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239907.846915:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 244 00000100:00100000:3.0:1782239907.852131:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239907.852233:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737934464 00000100:00100000:1.0:1782239907.852246:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737934464 00000100:00100000:1.0:1782239907.852305:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 245 00000100:00100000:1.0:1782239907.852315:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5decbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afaefb1a-536b-42a3-a3ff-47200f8611c3+13:5567:x1868813737934464:12345-192.168.203.32@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782239907.852695:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5decbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afaefb1a-536b-42a3-a3ff-47200f8611c3+13:5567:x1868813737934464:12345-192.168.203.32@tcp:501:ll_cfg_requeue.0 Request processed in 379us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239907.852713:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 245 00000100:00100000:1.0:1782239907.856076:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239907.856170:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737934592 00000100:00100000:3.0:1782239907.856183:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737934592 00000100:00100000:3.0:1782239907.856254:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 246 00000100:00100000:3.0:1782239907.856266:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5decbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afaefb1a-536b-42a3-a3ff-47200f8611c3+13:5567:x1868813737934592:12345-192.168.203.32@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782239907.856582:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5decbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afaefb1a-536b-42a3-a3ff-47200f8611c3+13:5567:x1868813737934592:12345-192.168.203.32@tcp:503:ll_cfg_requeue.0 Request processed in 316us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239907.856599:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 246 00000100:00100000:3.0:1782239907.864949:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239907.865067:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239907.865137:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737934848 00000100:00100000:1.0:1782239907.865155:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737934848 00000100:00100000:1.0:1782239907.865260:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737934720 00000100:00100000:1.0:1782239907.865264:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737934720 00000100:00100000:1.0:1782239907.865301:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 97 00000100:00100000:1.0:1782239907.865313:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7e0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f135cc01-3d42-4f2a-80ff-79724f1d3285+5:2347:x1868813737934848:12345-192.168.203.32@tcp:400:kworker.0 00000100:00080000:3.0:1782239907.865418:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782239907.865452:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7e0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f135cc01-3d42-4f2a-80ff-79724f1d3285+5:2347:x1868813737934848:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 140us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239907.865462:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 97 00000100:00100000:1.0:1782239907.865491:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 98 00000100:00100000:1.0:1782239907.865499:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7e0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+6:2347:x1868813737934720:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:1.0:1782239907.865529:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7e0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+6:2347:x1868813737934720:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 32us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239907.865536:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 98 00010000:00010000:2.0:1782239908.062942:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782239908.127634:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb601359180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1868813758943744:0@lo:400:kworker.0 00000100:00100000:0.0:1782239908.127655:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fff00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813758944000:0@lo:400:kworker.0 00000100:00100000:1.0:1782239908.127708:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239908.127786:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb601359c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3307:1868813758943616:0@lo:400:kworker.0 00000100:00100000:0.0:1782239908.133203:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239908.133385:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758943744 00000100:00100000:0.0:1782239908.133397:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758943744 00000100:00100000:0.0:1782239908.133470:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1782239908.133483:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fff00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1868813758943744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782239908.135717:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fff01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1868813758944256:0@lo:400:kworker.0 00000100:00100000:3.0:1782239908.138662:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239908.138736:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fff02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1868813758944128:0@lo:400:kworker.0 00000100:00100000:3.0:1782239908.139215:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239908.139281:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb60135b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1868813758943872:0@lo:400:kworker.0 00000100:00100000:3.0:1782239908.139305:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239908.139640:0:8312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758944000 00000100:00100000:3.0:1782239908.139650:0:8312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758944000 00000100:00100000:3.0:1782239908.139702:0:8312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1782239908.139712:0:8312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5eddf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1868813758944000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782239908.140162:0:8312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5eddf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1868813758944000:12345-0@lo:400:kworker.0 Request processed in 450us (6970us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239908.140172:0:8312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1782239908.140197:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758943616 00000100:00100000:3.0:1782239908.140201:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758943616 00000100:00100000:3.0:1782239908.140224:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1782239908.140231:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5decbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:3307:x1868813758943616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782239908.140267:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5decbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:3307:x1868813758943616:12345-0@lo:400:kworker.0 Request processed in 37us (1612us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239908.140274:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1782239908.140303:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758944128 00000100:00100000:3.0:1782239908.140319:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758944128 00000100:00100000:3.0:1782239908.140883:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758943872 00000100:00100000:3.0:1782239908.140888:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758943872 00000100:00100000:3.0:1782239908.140905:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1782239908.140911:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7e0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1868813758944128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782239908.140951:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7e0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1868813758944128:12345-0@lo:400:kworker.0 Request processed in 40us (1736us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239908.140958:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1782239908.140969:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1782239908.140975:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7e0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1868813758943872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782239908.141005:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7e0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1868813758943872:12345-0@lo:400:kworker.0 Request processed in 31us (1700us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239908.141011:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00080000:3.0:1782239908.141168:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782239908.141201:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb60135b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1868813758943872:0@lo:400:kworker.0 00000100:00100000:3.0:1782239908.141233:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb601359c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3307:1868813758943616:0@lo:400:kworker.0 00000100:00100000:3.0:1782239908.141244:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fff02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1868813758944128:0@lo:400:kworker.0 00000100:00100000:1.0:1782239908.142914:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1782239908.143030:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb5fff00700 x1868813758944000/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782239924 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782239908.143046:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fff00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813758944000:0@lo:400:kworker.0 00000100:00100000:1.0:1782239908.143094:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb601359180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1868813758943744:0@lo:400:kworker.0 00000100:00100000:0.0:1782239908.143094:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fff00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1868813758943744:12345-0@lo:400:kworker.0 Request processed in 9603us (15377us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239908.143118:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1782239908.143791:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758944256 00000100:00100000:3.0:1782239908.143803:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758944256 00000100:00100000:3.0:1782239908.143952:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1782239908.143964:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fff03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1868813758944256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782239908.144058:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fff03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1868813758944256:12345-0@lo:400:kworker.0 Request processed in 97us (1150us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239908.144066:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:0.0:1782239908.144249:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1782239908.145912:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb5fff01500 x1868813758944256/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782239924 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782239908.145971:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fff01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1868813758944256:0@lo:400:kworker.0 00000100:00100000:0.0:1782239908.638988:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5eddf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813758944384:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782239908.639505:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239908.639724:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758944384 00000100:00100000:0.0:1782239908.639735:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758944384 00000100:00100000:1.0:1782239908.640075:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1782239908.640091:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5eddf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1868813758944384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782239908.640140:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782239908.640211:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5eddf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1868813758944384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 125us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239908.640218:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:1.0:1782239908.641105:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb5eddf7800 x1868813758944384/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782239924 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782239908.641132:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5eddf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813758944384:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782239909.087025:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782239910.113073:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1782239910.626124:0:11216:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg332-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1782239911.137510:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782239912.160278:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782239912.224673:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782239912.224703:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f77f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1868813758944512:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782239912.224879:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239912.225033:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758944512 00000100:00100000:1.0:1782239912.225043:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758944512 00000100:00100000:1.0:1782239912.225117:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1782239912.225128:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f77f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1868813758944512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782239912.225179:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782239912.225238:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f77f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1868813758944512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239912.225246:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:1.0:1782239912.225292:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb5f77f3480 x1868813758944512/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782239928 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782239912.225328:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f77f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1868813758944512:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1782239912.225503:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782239912.979593:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239912.979651:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239912.979719:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239912.979797:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737935104 00000100:00100000:1.0:1782239912.979809:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737934976 00000100:00100000:3.0:1782239912.979811:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737935104 00000100:00100000:1.0:1782239912.979817:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737934976 00000100:00100000:3.0:1782239912.979880:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737935232 00000100:00100000:3.0:1782239912.979884:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737935232 00000100:00100000:1.0:1782239912.979888:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 248 00000100:00100000:1.0:1782239912.979901:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d0330050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afaefb1a-536b-42a3-a3ff-47200f8611c3+13:2347:x1868813737934976:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:3.0:1782239912.979919:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 102 00000100:00100000:3.0:1782239912.979930:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7e0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+6:2347:x1868813737935104:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:2.0:1782239912.980015:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 103 00000100:00100000:2.0:1782239912.980029:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb601359180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f135cc01-3d42-4f2a-80ff-79724f1d3285+5:2347:x1868813737935232:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:1.0:1782239912.980094:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d0330050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afaefb1a-536b-42a3-a3ff-47200f8611c3+13:2347:x1868813737934976:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 195us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239912.980103:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 248 00000100:00100000:3.0:1782239912.986404:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7e0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+6:2347:x1868813737935104:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 6448us (6796us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239912.986424:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 102 00000100:00080000:3.0:1782239912.986494:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782239912.995697:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb601359180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f135cc01-3d42-4f2a-80ff-79724f1d3285+5:2347:x1868813737935232:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 15654us (15956us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239912.995732:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 103 00010000:00010000:1.0:1782239913.185422:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782239913.247168:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5c513ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1868813758944896:0@lo:400:kworker.0 00000100:00100000:2.0:1782239913.247268:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239913.247346:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1782239913.247352:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5c513c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1868813758944768:0@lo:400:kworker.0 00000100:00100000:2.0:1782239913.247373:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239913.247399:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5c513c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813758945280:0@lo:400:kworker.0 00000100:00100000:2.0:1782239913.247423:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239913.247463:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758944896 00000100:00100000:2.0:1782239913.247472:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758944896 00000100:00100000:2.0:1782239913.247526:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758944768 00000100:00100000:2.0:1782239913.247545:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758944768 00000100:00100000:2.0:1782239913.247573:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1782239913.247582:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1868813758944896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782239913.247640:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1868813758944896:12345-0@lo:400:kworker.0 Request processed in 58us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239913.247647:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1782239913.247676:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1782239913.247683:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1868813758944768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782239913.247713:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1868813758944768:12345-0@lo:400:kworker.0 Request processed in 31us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239913.247719:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1782239913.247742:0:8312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758945280 00000100:00100000:2.0:1782239913.247745:0:8312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758945280 00000100:00080000:0.0:1782239913.247782:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782239913.247789:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782239913.247804:0:8312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1782239913.247811:0:8312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1868813758945280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782239913.247870:0:8312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1868813758945280:12345-0@lo:400:kworker.0 Request processed in 60us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239913.247877:0:8312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1782239913.247918:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5c513c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1868813758944768:0@lo:400:kworker.0 00010000:00080000:2.0:1782239913.247932:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb5c513c000 x1868813758945280/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782239929 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782239913.247943:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5c513c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813758945280:0@lo:400:kworker.0 00000100:00100000:2.0:1782239913.247953:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5c513ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1868813758944896:0@lo:400:kworker.0 00000100:00100000:3.0:1782239913.249054:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5c513ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813758945024:0@lo:400:kworker.0 00000100:00100000:1.0:1782239913.249054:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f77f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3307:1868813758944640:0@lo:400:kworker.0 00000100:00100000:1.0:1782239913.249124:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239913.249125:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239913.249176:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5c513f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1868813758945152:0@lo:400:kworker.0 00000100:00100000:1.0:1782239913.249201:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239913.249230:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758945152 00000100:00100000:3.0:1782239913.249236:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758945152 00000100:00100000:3.0:1782239913.249295:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1782239913.249303:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fff01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1868813758945152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782239913.249353:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fff01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1868813758945152:12345-0@lo:400:kworker.0 Request processed in 51us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239913.249360:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:1.0:1782239913.249420:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782239913.249446:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758945024 00000100:00100000:0.0:1782239913.249451:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758945024 00000100:00100000:1.0:1782239913.249455:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5c513f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1868813758945152:0@lo:400:kworker.0 00000100:00100000:0.0:1782239913.249490:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1782239913.249498:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb601359c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1868813758945024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782239913.249547:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb601359c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1868813758945024:12345-0@lo:400:kworker.0 Request processed in 51us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239913.249554:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:1.0:1782239913.249653:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb5c513ca80 x1868813758945024/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782239929 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782239913.249666:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5c513ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813758945024:0@lo:400:kworker.0 00000100:00100000:2.0:1782239913.249744:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758944640 00000100:00100000:2.0:1782239913.249788:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758944640 00000100:00100000:2.0:1782239913.249832:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1782239913.249839:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d0330c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:3307:x1868813758944640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782239913.249884:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d0330c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:3307:x1868813758944640:12345-0@lo:400:kworker.0 Request processed in 47us (761us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239913.249890:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1782239913.250049:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f77f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3307:1868813758944640:0@lo:400:kworker.0 00000100:00100000:3.0:1782239913.759323:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782239913.759356:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5eddf4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1868813758945408:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782239913.759476:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239913.760321:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758945408 00000100:00100000:0.0:1782239913.760337:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758945408 00000100:00100000:0.0:1782239913.760420:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1782239913.760435:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb60135b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1868813758945408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782239913.760496:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782239913.760586:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb60135b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1868813758945408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 154us (1110us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239913.760595:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:3.0:1782239913.765157:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb5eddf4e00 x1868813758945408/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782239929 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782239913.765212:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5eddf4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1868813758945408:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782239914.207180:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1782239914.516778:0:11316:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 14:38:32 (1782239912) === 00000100:00100000:3.0:1782239914.686804:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239914.686860:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239914.687383:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737935360 00000100:00100000:1.0:1782239914.687397:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737935360 00000100:00080000:3.0:1782239914.687461:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782239914.687492:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 14 00000100:00100000:1.0:1782239914.687508:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f780e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+6:2347:x1868813737935360:12345-192.168.203.32@tcp:41:mkdir.0 00000004:00000024:1.0:1782239914.687575:0:5791:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1782239914.687701:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f780e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+6:2347:x1868813737935360:12345-192.168.203.32@tcp:41:mkdir.0 Request processed in 197us (913us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239914.687711:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 14 00000100:00100000:1.0:1782239914.687771:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737935488 00000100:00100000:1.0:1782239914.687776:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737935488 00000100:00100000:1.0:1782239914.687804:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 0 00000100:00100000:1.0:1782239914.687812:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f780d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:36dd742b-25b8-431e-bf41-75f2fff47ffb+6:9668:x1868813737935488:12345-192.168.203.32@tcp:700:mkdir.0 00000100:00100000:1.0:1782239914.687853:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f780d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:36dd742b-25b8-431e-bf41-75f2fff47ffb+6:9668:x1868813737935488:12345-192.168.203.32@tcp:700:mkdir.0 Request processed in 41us (992us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239914.687860:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 0 00000100:00100000:3.0:1782239914.692586:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239914.692851:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737935744 00000100:00100000:2.0:1782239914.692865:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737935744 00000100:00100000:2.0:1782239914.692952:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 15 00000100:00100000:2.0:1782239914.692965:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f780ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+6:9668:x1868813737935744:12345-192.168.203.32@tcp:36:mkdir.0 00010000:00010000:2.0:1782239914.693043:0:6611:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782239914.693079:0:6611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44600/0x8c5345f1c1ec4c78 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e3d5 expref: 6 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239914.693106:0:6611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bb5d0df4100) 00010000:00010000:2.0:1782239914.693130:0:6611:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782239914.693539:0:6611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29f200/0x8c5345f1c1ec4d97 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239914.693555:0:6611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29f200/0x8c5345f1c1ec4d97 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239914.693567:0:6611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29f200/0x8c5345f1c1ec4d97 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239914.694662:0:6611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29f800/0x8c5345f1c1ec4d9e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239914.694688:0:6611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29f800/0x8c5345f1c1ec4d9e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239914.694702:0:6611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29f800/0x8c5345f1c1ec4d9e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782239914.701468:0:6611:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:2.0:1782239914.701495:0:6611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29f200/0x8c5345f1c1ec4d97 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239914.701509:0:6611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29f200/0x8c5345f1c1ec4d97 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239914.701516:0:6611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29f200/0x8c5345f1c1ec4d97 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239914.701523:0:6611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5ee29f200 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:2.0:1782239914.701527:0:6611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29f200/0x8c5345f1c1ec4d97 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239914.701547:0:6611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29f200/0x8c5345f1c1ec4d97 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239914.701564:0:6611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bb5c4ed6900) 00010000:00010000:2.0:1782239914.701566:0:6611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782239914.701571:0:6611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29f200/0x8c5345f1c1ec4d97 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239914.701577:0:6611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29f200/0x8c5345f1c1ec4d97 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782239914.701601:0:6611:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004bf82030 reply state 0000000054147e55 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29f800/0x8c5345f1c1ec4d9e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239914.701634:0:6611:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782239914.701902:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f780ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+7:9668:x1868813737935744:12345-192.168.203.32@tcp:36:mkdir.0 Request processed in 8936us (9327us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1782239914.701914:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 15 00010000:00010000:2.0:1782239914.703359:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29f800/0x8c5345f1c1ec4d9e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239914.703385:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29f800/0x8c5345f1c1ec4d9e lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239914.703393:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29f800/0x8c5345f1c1ec4d9e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239914.703401:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5ee29f800 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:2.0:1782239914.703406:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29f800/0x8c5345f1c1ec4d9e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239914.703431:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29f800/0x8c5345f1c1ec4d9e lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239914.703450:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9bb5c4ed6a00) 00010000:00010000:2.0:1782239914.703453:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782239914.703457:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29f800/0x8c5345f1c1ec4d9e lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239914.703464:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29f800/0x8c5345f1c1ec4d9e lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239914.714715:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239914.715843:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737935872 00000100:00100000:0.0:1782239914.715860:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737935872 00000100:00100000:0.0:1782239914.715947:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 16 00000100:00100000:0.0:1782239914.715960:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ee2fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+6:9669:x1868813737935872:12345-192.168.203.32@tcp:101:chmod.0 00010000:00010000:0.0:1782239914.715988:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782239914.716024:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030a00/0x8c5345f1c1ec4da5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e45a expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239914.716111:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030c00/0x8c5345f1c1ec4dac lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239914.716130:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030c00/0x8c5345f1c1ec4dac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239914.716146:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030c00/0x8c5345f1c1ec4dac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782239914.716237:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1782239914.716251:0:5791:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1782239914.716317:0:5791:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030c00/0x8c5345f1c1ec4dac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239914.716350:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030a00/0x8c5345f1c1ec4da5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e45a expref: 8 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239914.716372:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030c00/0x8c5345f1c1ec4dac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e45a expref: 7 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239914.716401:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bb5c55def00) 00010000:00010000:0.0:1782239914.716405:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782239914.716409:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5c0030c00, rc 0) 00000100:00100000:0.0:1782239914.716487:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ee2fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+7:9669:x1868813737935872:12345-192.168.203.32@tcp:101:chmod.0 Request processed in 530us (1786us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239914.716496:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 16 00000100:00100000:3.0:1782239914.724629:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239914.724684:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737936128 00000100:00100000:3.0:1782239914.724696:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737936128 00000100:00100000:3.0:1782239914.724782:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 17 00000100:00100000:3.0:1782239914.724795:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ee2fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+7:9669:x1868813737936128:12345-192.168.203.32@tcp:36:chmod.0 00010000:00010000:3.0:1782239914.724870:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782239914.724907:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030c00/0x8c5345f1c1ec4dac lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e45a expref: 7 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239914.724933:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bb5c55def00) 00010000:00010000:3.0:1782239914.724946:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782239914.724979:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a45600/0x8c5345f1c1ec4db3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239914.724995:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a45600/0x8c5345f1c1ec4db3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239914.725008:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a45600/0x8c5345f1c1ec4db3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782239914.725443:0:5790:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008ce93f7d reply state 000000000aceadae transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a45600/0x8c5345f1c1ec4db3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239914.725456:0:5790:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1782239914.725482:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1782239914.725590:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ee2fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+8:9669:x1868813737936128:12345-192.168.203.32@tcp:36:chmod.0 Request processed in 797us (973us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1782239914.725599:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 17 00010000:00010000:1.0:1782239914.731784:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a45600/0x8c5345f1c1ec4db3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239914.731808:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a45600/0x8c5345f1c1ec4db3 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239914.731817:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a45600/0x8c5345f1c1ec4db3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239914.731826:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5c2a45600 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:1.0:1782239914.731833:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a45600/0x8c5345f1c1ec4db3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239914.731843:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a45600/0x8c5345f1c1ec4db3 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239914.731872:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bb5d0df4900) 00010000:00010000:1.0:1782239914.731876:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1782239914.731882:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a45600/0x8c5345f1c1ec4db3 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239914.731901:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a45600/0x8c5345f1c1ec4db3 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782239914.769266:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239914.769948:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737936256 00000100:00100000:1.0:1782239914.769963:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737936256 00000100:00100000:1.0:1782239914.770031:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 18 00000100:00100000:1.0:1782239914.770043:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5eddf7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+7:9670:x1868813737936256:12345-192.168.203.32@tcp:101:chown.0 00010000:00010000:1.0:1782239914.770075:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782239914.770105:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c1676400/0x8c5345f1c1ec4dba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e461 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239914.770193:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c1677000/0x8c5345f1c1ec4dc1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239914.770210:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c1677000/0x8c5345f1c1ec4dc1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239914.770223:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c1677000/0x8c5345f1c1ec4dc1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782239914.770304:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1782239914.770309:0:5791:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1782239914.770358:0:5791:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c1677000/0x8c5345f1c1ec4dc1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239914.770399:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c1676400/0x8c5345f1c1ec4dba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e461 expref: 9 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239914.770422:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c1677000/0x8c5345f1c1ec4dc1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e461 expref: 8 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239914.770449:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bb5c30e4e00) 00010000:00010000:1.0:1782239914.770452:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782239914.770456:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5c1677000, rc 0) 00000100:00100000:1.0:1782239914.770529:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5eddf7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+8:9670:x1868813737936256:12345-192.168.203.32@tcp:101:chown.0 Request processed in 488us (1279us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239914.770538:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 18 00000100:00100000:1.0:1782239914.784351:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239914.784426:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737936384 00000100:00100000:1.0:1782239914.784438:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737936384 00000100:00100000:1.0:1782239914.784510:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 19 00000100:00100000:1.0:1782239914.784523:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fff00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+8:9670:x1868813737936384:12345-192.168.203.32@tcp:101:chown.0 00010000:00010000:1.0:1782239914.784550:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782239914.784581:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c1677800/0x8c5345f1c1ec4dc8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e468 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239914.784698:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38200/0x8c5345f1c1ec4dcf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239914.784718:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38200/0x8c5345f1c1ec4dcf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239914.784732:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38200/0x8c5345f1c1ec4dcf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239914.784770:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38600/0x8c5345f1c1ec4dd6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239914.784780:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38600/0x8c5345f1c1ec4dd6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239914.784796:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38600/0x8c5345f1c1ec4dd6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239914.784922:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39c00/0x8c5345f1c1ec4ddd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239914.784931:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39c00/0x8c5345f1c1ec4ddd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239914.784938:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39c00/0x8c5345f1c1ec4ddd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782239914.784987:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:1.0:1782239914.784991:0:5790:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782239914.785018:0:5790:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39c00/0x8c5345f1c1ec4ddd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239914.785035:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38200/0x8c5345f1c1ec4dcf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239914.785043:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38200/0x8c5345f1c1ec4dcf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239914.785051:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38200/0x8c5345f1c1ec4dcf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239914.785059:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f7e38200 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:1.0:1782239914.785064:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38200/0x8c5345f1c1ec4dcf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239914.785073:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38200/0x8c5345f1c1ec4dcf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239914.785097:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bb5c30e4e00) 00010000:00010000:1.0:1782239914.785100:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782239914.785107:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38200/0x8c5345f1c1ec4dcf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239914.785115:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38200/0x8c5345f1c1ec4dcf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239914.785133:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38600/0x8c5345f1c1ec4dd6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239914.785140:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38600/0x8c5345f1c1ec4dd6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239914.785147:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38600/0x8c5345f1c1ec4dd6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239914.785152:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f7e38600 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:1.0:1782239914.785155:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38600/0x8c5345f1c1ec4dd6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239914.785163:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38600/0x8c5345f1c1ec4dd6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239914.785170:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9bb5c30e4a00) 00010000:00010000:1.0:1782239914.785173:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782239914.785177:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38600/0x8c5345f1c1ec4dd6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239914.785183:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38600/0x8c5345f1c1ec4dd6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239914.785230:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c1677800/0x8c5345f1c1ec4dc8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e468 expref: 10 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239914.785246:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39c00/0x8c5345f1c1ec4ddd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e468 expref: 9 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239914.785254:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9bb5c30e4100) 00010000:00010000:1.0:1782239914.785257:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782239914.785259:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5f7e39c00, rc 0) 00000100:00100000:1.0:1782239914.785340:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fff00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+9:9670:x1868813737936384:12345-192.168.203.32@tcp:101:chown.0 Request processed in 820us (1004us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239914.785350:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 19 00000100:00100000:1.0:1782239914.800651:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239914.800799:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737936640 00000100:00100000:0.0:1782239914.800813:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737936640 00000100:00100000:0.0:1782239914.800889:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 20 00000100:00100000:0.0:1782239914.800901:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fff03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+9:9670:x1868813737936640:12345-192.168.203.32@tcp:36:chown.0 00010000:00010000:0.0:1782239914.800979:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782239914.801015:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39c00/0x8c5345f1c1ec4ddd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e468 expref: 9 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239914.801040:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9bb5c30e4100) 00010000:00010000:0.0:1782239914.801054:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782239914.801088:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030a00/0x8c5345f1c1ec4de4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239914.801120:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030a00/0x8c5345f1c1ec4de4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239914.801132:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030a00/0x8c5345f1c1ec4de4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782239914.914110:0:5812:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:1.0:1782239914.914232:0:5791:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002eeaf901 reply state 000000007fcb24b6 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030a00/0x8c5345f1c1ec4de4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239914.914250:0:5791:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1782239914.914469:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00080000:1.0:1782239914.914607:0:5791:0:(ldlm_lib.c:3441:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1782239914.914632:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fff03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+7:9670:x1868813737936640:12345-192.168.203.32@tcp:36:chown.0 Request processed in 113727us (113992us total) trans 4294967299 rc 0/0 00010000:00010000:2.0:1782239914.914741:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030a00/0x8c5345f1c1ec4de4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239914.914773:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030a00/0x8c5345f1c1ec4de4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239914.914783:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030a00/0x8c5345f1c1ec4de4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239914.914790:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5c0030a00 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:2.0:1782239914.914796:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030a00/0x8c5345f1c1ec4de4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239914.914806:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030a00/0x8c5345f1c1ec4de4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239914.914825:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9bb5c55de600) 00010000:00010000:2.0:1782239914.914829:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1782239914.914842:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030a00/0x8c5345f1c1ec4de4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239914.914850:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030a00/0x8c5345f1c1ec4de4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239914.914918:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 20 00000100:00100000:1.0:1782239914.940812:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239914.941055:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737936768 00000100:00100000:3.0:1782239914.941069:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737936768 00000100:00100000:3.0:1782239914.941147:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 21 00000100:00100000:3.0:1782239914.941160:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fff02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+6:9671:x1868813737936768:12345-192.168.203.32@tcp:101:touch.500 00010000:00010000:3.0:1782239914.941194:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782239914.941222:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44200/0x8c5345f1c1ec4deb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e46f expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782239914.970127:0:5790:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 28839us 00010000:00010000:3.0:1782239915.008846:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44e00/0x8c5345f1c1ec4df2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.008875:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44e00/0x8c5345f1c1ec4df2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.008891:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44e00/0x8c5345f1c1ec4df2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.008907:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44c00/0x8c5345f1c1ec4df9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.008914:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44c00/0x8c5345f1c1ec4df9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.008921:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44c00/0x8c5345f1c1ec4df9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.009399:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44a00/0x8c5345f1c1ec4e00 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.009410:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44a00/0x8c5345f1c1ec4e00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.009418:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44a00/0x8c5345f1c1ec4e00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782239915.009503:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1782239915.009508:0:5790:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782239915.009599:0:5790:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44a00/0x8c5345f1c1ec4e00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.009614:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44e00/0x8c5345f1c1ec4df2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.009620:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44e00/0x8c5345f1c1ec4df2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.009628:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44e00/0x8c5345f1c1ec4df2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.009633:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5c2a44e00 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:3.0:1782239915.009638:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44e00/0x8c5345f1c1ec4df2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.009718:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44e00/0x8c5345f1c1ec4df2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.009735:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bb5c30e4e00) 00010000:00010000:3.0:1782239915.009745:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782239915.009782:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44e00/0x8c5345f1c1ec4df2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.009788:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44e00/0x8c5345f1c1ec4df2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.009804:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44c00/0x8c5345f1c1ec4df9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.009810:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44c00/0x8c5345f1c1ec4df9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.009816:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44c00/0x8c5345f1c1ec4df9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.009821:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5c2a44c00 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:3.0:1782239915.009824:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44c00/0x8c5345f1c1ec4df9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.009830:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44c00/0x8c5345f1c1ec4df9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.009838:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9bb5d0df4500) 00010000:00010000:3.0:1782239915.009840:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782239915.009843:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44c00/0x8c5345f1c1ec4df9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.009849:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44c00/0x8c5345f1c1ec4df9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.009895:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44200/0x8c5345f1c1ec4deb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e46f expref: 8 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.009921:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44a00/0x8c5345f1c1ec4e00 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e46f expref: 7 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.009929:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9bb5d0df4b00) 00010000:00010000:3.0:1782239915.009931:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1782239915.009934:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5c2a44a00, rc 0) 00000100:00100000:3.0:1782239915.010020:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fff02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+7:9671:x1868813737936768:12345-192.168.203.32@tcp:101:touch.500 Request processed in 68863us (69280us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239915.010031:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 21 00000100:00100000:3.0:1782239915.015904:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239915.015976:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737937024 00000100:00100000:3.0:1782239915.015989:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737937024 00000100:00100000:3.0:1782239915.016054:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 22 00000100:00100000:3.0:1782239915.016064:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ee2fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+7:9671:x1868813737937024:12345-192.168.203.32@tcp:101:touch.500 00010000:00010000:3.0:1782239915.016094:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782239915.016122:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a45600/0x8c5345f1c1ec4e07 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e476 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.016552:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44600/0x8c5345f1c1ec4e0e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.016572:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44600/0x8c5345f1c1ec4e0e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.016585:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44600/0x8c5345f1c1ec4e0e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.016615:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044a00/0x8c5345f1c1ec4e15 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.016622:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044a00/0x8c5345f1c1ec4e15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.016629:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044a00/0x8c5345f1c1ec4e15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782239915.021276:0:5792:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:3.0:1782239915.021709:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602045000/0x8c5345f1c1ec4e1c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.021732:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602045000/0x8c5345f1c1ec4e1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.026521:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602045000/0x8c5345f1c1ec4e1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.026638:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44600/0x8c5345f1c1ec4e0e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.026648:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44600/0x8c5345f1c1ec4e0e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.026656:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44600/0x8c5345f1c1ec4e0e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.026663:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5c2a44600 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:3.0:1782239915.026668:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44600/0x8c5345f1c1ec4e0e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.026700:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44600/0x8c5345f1c1ec4e0e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.026721:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9bb5d0df4b00) 00010000:00010000:3.0:1782239915.026724:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782239915.026730:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44600/0x8c5345f1c1ec4e0e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.026736:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44600/0x8c5345f1c1ec4e0e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782239915.026818:0:5792:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000097cfe3b6 reply state 00000000a761778b transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044a00/0x8c5345f1c1ec4e15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239915.026830:0:5792:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1782239915.026888:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a45600/0x8c5345f1c1ec4e07 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e476 expref: 10 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.026905:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602045000/0x8c5345f1c1ec4e1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e476 expref: 9 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.026913:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9bb5d0df4300) 00010000:00010000:3.0:1782239915.026915:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782239915.026918:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb602045000, rc 0) 00000100:00100000:3.0:1782239915.027011:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ee2fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+10:9671:x1868813737937024:12345-192.168.203.32@tcp:101:touch.500 Request processed in 10947us (11121us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1782239915.027020:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 22 00010000:00010000:0.0:1782239915.032041:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044a00/0x8c5345f1c1ec4e15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239915.032063:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044a00/0x8c5345f1c1ec4e15 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239915.032072:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044a00/0x8c5345f1c1ec4e15 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239915.032079:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb602044a00 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:0.0:1782239915.032085:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044a00/0x8c5345f1c1ec4e15 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239915.032093:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044a00/0x8c5345f1c1ec4e15 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239915.032115:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xe219b27a (ffff9bb5d0df4e00) 00010000:00010000:0.0:1782239915.032118:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782239915.032122:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044a00/0x8c5345f1c1ec4e15 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239915.032128:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044a00/0x8c5345f1c1ec4e15 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782239915.036975:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239915.037092:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737937280 00000100:00100000:1.0:1782239915.037106:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737937280 00000100:00100000:1.0:1782239915.037189:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 23 00000100:00100000:1.0:1782239915.037202:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5eddf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+9:9671:x1868813737937280:12345-192.168.203.32@tcp:36:touch.500 00010000:00010000:1.0:1782239915.037292:0:6611:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782239915.037330:0:6611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602045000/0x8c5345f1c1ec4e1c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e476 expref: 9 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239915.037360:0:6611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9bb5d0df4300) 00010000:00010000:1.0:1782239915.037383:0:6611:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782239915.037444:0:6611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38200/0x8c5345f1c1ec4e2a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239915.037459:0:6611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38200/0x8c5345f1c1ec4e2a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239915.037470:0:6611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38200/0x8c5345f1c1ec4e2a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782239915.037654:0:6611:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000063fb20e4 reply state 00000000558912dd transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38200/0x8c5345f1c1ec4e2a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239915.037665:0:6611:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782239915.037814:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5eddf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+10:9671:x1868813737937280:12345-192.168.203.32@tcp:36:touch.500 Request processed in 613us (852us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1782239915.037822:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 23 00000100:00100000:3.0:1782239915.041330:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239915.041417:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737937408 00000100:00100000:0.0:1782239915.041431:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737937408 00000100:00100000:0.0:1782239915.041509:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 24 00000100:00100000:0.0:1782239915.041520:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ee2fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+10:9671:x1868813737937408:12345-192.168.203.32@tcp:101:touch.500 00010000:00010000:0.0:1782239915.041555:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782239915.041582:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030800/0x8c5345f1c1ec4e31 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e47d expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239915.041662:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030800/0x8c5345f1c1ec4e31 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e47d expref: 11 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239915.041681:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030800/0x8c5345f1c1ec4e31 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e47d expref: 11 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239915.041705:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9bb5c30e4b00) 00010000:00010000:0.0:1782239915.041708:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782239915.041712:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5c0030800, rc 0) 00000100:00100000:0.0:1782239915.041821:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ee2fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+11:9671:x1868813737937408:12345-192.168.203.32@tcp:101:touch.500 Request processed in 301us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239915.041829:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 24 00010000:00010000:1.0:1782239915.042028:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38200/0x8c5345f1c1ec4e2a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239915.042038:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38200/0x8c5345f1c1ec4e2a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239915.042046:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38200/0x8c5345f1c1ec4e2a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239915.042070:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f7e38200 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:1.0:1782239915.042075:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38200/0x8c5345f1c1ec4e2a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239915.042085:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38200/0x8c5345f1c1ec4e2a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239915.042101:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9bb5c30e4b00) 00010000:00010000:1.0:1782239915.042104:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782239915.042108:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38200/0x8c5345f1c1ec4e2a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239915.042115:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38200/0x8c5345f1c1ec4e2a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782239915.047346:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239915.047461:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737937536 00000100:00100000:3.0:1782239915.047492:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737937536 00000100:00100000:3.0:1782239915.047556:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 16 00000100:00100000:3.0:1782239915.047566:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5eddf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2343:x1868813737937536:12345-192.168.203.32@tcp:8:touch.500 00010000:00080000:3.0:1782239915.047623:0:6588:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 36dd742b-25b8-431e-bf41-75f2fff47ffb@192.168.203.32@tcp t0 exp 0000000000000000 cur 294 last 0 00000020:00000080:3.0:1782239915.047669:0:6588:0:(genops.c:1406:class_connect()) connect: client 36dd742b-25b8-431e-bf41-75f2fff47ffb, cookie 0x8c5345f1c1ec4e38 00002000:00100000:3.0:1782239915.047686:0:6588:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 36dd742b-25b8-431e-bf41-75f2fff47ffb/ffff9bb60166f000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1782239915.047716:0:6588:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1782239915.048170:0:6588:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1782239915.048216:0:6588:0:(import.c:65:import_set_state_nolock()) ffff9bb5d8199000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782239915.048319:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5eddf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+6:2343:x1868813737937536:12345-192.168.203.32@tcp:8:touch.500 Request processed in 753us (987us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239915.048330:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 16 00000100:00100000:2.0:1782239915.056873:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239915.060502:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737937664 00000100:00100000:0.0:1782239915.060526:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737937664 00000100:00100000:0.0:1782239915.060675:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 17 00000100:00100000:0.0:1782239915.060688:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+6:0:x1868813737937664:12345-192.168.203.32@tcp:2:touch.500 00000100:00080000:3.0:1782239915.061254:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1782239915.173476:0:6614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00100000:2.0:1782239915.173505:0:6614:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 36dd742b-25b8-431e-bf41-75f2fff47ffb 00000100:00100000:1.0:1782239915.173813:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+5:0:x1868813737937664:12345-192.168.203.32@tcp:2:touch.500 Request processed in 113119us (116958us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1782239915.173829:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 17 00000100:00100000:3.0:1782239915.181951:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239915.182107:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737937920 00000100:00100000:0.0:1782239915.182120:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737937920 00000100:00100000:0.0:1782239915.182196:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 2 00000100:00100000:0.0:1782239915.182209:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ee2ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+10:9671:x1868813737937920:12345-192.168.203.32@tcp:35:touch.500 00000100:00100000:0.0:1782239915.182702:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ee2ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+11:9671:x1868813737937920:12345-192.168.203.32@tcp:35:touch.500 Request processed in 492us (762us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1782239915.182712:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 2 00000100:00100000:2.0:1782239915.204817:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239915.204914:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737938048 00000100:00100000:3.0:1782239915.204927:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737938048 00000100:00100000:3.0:1782239915.205011:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 25 00000100:00100000:3.0:1782239915.205023:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+11:9672:x1868813737938048:12345-192.168.203.32@tcp:101:rm.0 00010000:00010000:3.0:1782239915.205057:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782239915.205084:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044000/0x8c5345f1c1ec4e3f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e484 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.205174:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044e00/0x8c5345f1c1ec4e46 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.205204:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044e00/0x8c5345f1c1ec4e46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.205218:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044e00/0x8c5345f1c1ec4e46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782239915.205301:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1782239915.205306:0:5790:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1782239915.205384:0:5790:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044e00/0x8c5345f1c1ec4e46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.205415:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044000/0x8c5345f1c1ec4e3f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e484 expref: 13 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.205437:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044e00/0x8c5345f1c1ec4e46 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e484 expref: 12 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.205447:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9bb5d0df4b00) 00010000:00010000:3.0:1782239915.205450:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782239915.205454:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb602044e00, rc 0) 00000100:00100000:3.0:1782239915.205523:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+12:9672:x1868813737938048:12345-192.168.203.32@tcp:101:rm.0 Request processed in 501us (722us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239915.205530:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 25 00000100:00100000:2.0:1782239915.219858:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239915.220262:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737938304 00000100:00100000:3.0:1782239915.220278:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737938304 00000100:00100000:3.0:1782239915.220358:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 26 00000100:00100000:3.0:1782239915.220380:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+12:9672:x1868813737938304:12345-192.168.203.32@tcp:101:rm.0 00010000:00010000:3.0:1782239915.220410:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782239915.220441:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044000/0x8c5345f1c1ec4e4d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e48b expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782239915.220605:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1782239915.220893:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044000/0x8c5345f1c1ec4e4d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e48b expref: 14 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.220913:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bb5c30e4e00) 00010000:00010000:3.0:1782239915.220923:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782239915.220931:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044000/0x8c5345f1c1ec4e4d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e48b expref: 14 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.220949:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb602044000, rc 0) 00000100:00100000:3.0:1782239915.221038:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+13:9672:x1868813737938304:12345-192.168.203.32@tcp:101:rm.0 Request processed in 670us (1195us total) trans 4294967303 rc 301/301 00000100:00100000:3.0:1782239915.221048:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 26 00010000:00010000:1.0:1782239915.234184:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782239915.234477:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239915.234578:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737938432 00000100:00100000:3.0:1782239915.234592:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737938432 00000100:00100000:3.0:1782239915.234667:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 3 00000100:00100000:3.0:1782239915.234679:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5eddf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+13:9672:x1868813737938432:12345-192.168.203.32@tcp:37:rm.0 00000100:00100000:3.0:1782239915.241499:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5eddf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+13:9672:x1868813737938432:12345-192.168.203.32@tcp:37:rm.0 Request processed in 6804us (7014us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239915.241518:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 3 00000100:00100000:0.0:1782239915.252248:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239915.255588:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737938688 00000100:00100000:2.0:1782239915.255608:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737938688 00000100:00100000:2.0:1782239915.256584:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 4 00000100:00100000:2.0:1782239915.256603:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5c77e0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+13:9672:x1868813737938688:12345-192.168.203.32@tcp:35:rm.0 00000100:00100000:2.0:1782239915.257016:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5c77e0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+14:9672:x1868813737938688:12345-192.168.203.32@tcp:35:rm.0 Request processed in 419us (4785us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1782239915.257026:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 4 00000100:00100000:0.0:1782239915.268146:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239915.268498:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737938944 00000100:00100000:3.0:1782239915.268513:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737938944 00000100:00100000:3.0:1782239915.268592:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 27 00000100:00100000:3.0:1782239915.268605:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5eddf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+14:9672:x1868813737938944:12345-192.168.203.32@tcp:101:rm.0 00010000:00010000:3.0:1782239915.268714:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782239915.268744:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044000/0x8c5345f1c1ec4e5b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e492 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.269017:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044a00/0x8c5345f1c1ec4e62 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.269038:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044a00/0x8c5345f1c1ec4e62 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.269074:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044a00/0x8c5345f1c1ec4e62 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782239915.269090:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1782239915.269267:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044000/0x8c5345f1c1ec4e5b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e492 expref: 17 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.269295:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044a00/0x8c5345f1c1ec4e62 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e492 expref: 16 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.269306:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9bb5d0df4b00) 00010000:00010000:3.0:1782239915.269310:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1782239915.269314:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb602044a00, rc 0) 00000100:00100000:3.0:1782239915.269422:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5eddf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+16:9672:x1868813737938944:12345-192.168.203.32@tcp:101:rm.0 Request processed in 820us (1293us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1782239915.269432:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 27 00000100:00100000:0.0:1782239915.274842:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239915.274963:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737939072 00000100:00100000:3.0:1782239915.274977:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737939072 00000100:00100000:3.0:1782239915.275043:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 28 00000100:00100000:3.0:1782239915.275054:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5eddf7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+16:9672:x1868813737939072:12345-192.168.203.32@tcp:41:rm.0 00000004:00000024:3.0:1782239915.275132:0:5792:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:3.0:1782239915.275223:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5eddf7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+16:9672:x1868813737939072:12345-192.168.203.32@tcp:41:rm.0 Request processed in 170us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239915.275231:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 28 00000100:00100000:0.0:1782239915.284099:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239915.284570:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737939200 00000100:00100000:3.0:1782239915.284584:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737939200 00000100:00100000:3.0:1782239915.284686:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 29 00000100:00100000:3.0:1782239915.284699:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5eddf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+16:9672:x1868813737939200:12345-192.168.203.32@tcp:101:rm.0 00010000:00010000:3.0:1782239915.284729:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782239915.284785:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044000/0x8c5345f1c1ec4e70 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e499 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.284872:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602045000/0x8c5345f1c1ec4e77 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.284892:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602045000/0x8c5345f1c1ec4e77 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.284906:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602045000/0x8c5345f1c1ec4e77 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.284924:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a45600/0x8c5345f1c1ec4e7e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xe219b27a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.284930:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a45600/0x8c5345f1c1ec4e7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.284936:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a45600/0x8c5345f1c1ec4e7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.285073:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44600/0x8c5345f1c1ec4e85 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.285082:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44600/0x8c5345f1c1ec4e85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.285089:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44600/0x8c5345f1c1ec4e85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782239915.285136:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:3.0:1782239915.285141:0:5790:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782239915.285163:0:5790:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44600/0x8c5345f1c1ec4e85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.285176:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44600/0x8c5345f1c1ec4e85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.285186:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602045000/0x8c5345f1c1ec4e77 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.285193:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602045000/0x8c5345f1c1ec4e77 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.285199:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602045000/0x8c5345f1c1ec4e77 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.285206:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb602045000 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:3.0:1782239915.285211:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602045000/0x8c5345f1c1ec4e77 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.285219:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602045000/0x8c5345f1c1ec4e77 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.285233:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9bb5d0df4b00) 00010000:00010000:3.0:1782239915.285237:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782239915.285242:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602045000/0x8c5345f1c1ec4e77 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.285248:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602045000/0x8c5345f1c1ec4e77 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.285277:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a45600/0x8c5345f1c1ec4e7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.285283:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a45600/0x8c5345f1c1ec4e7e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.285288:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a45600/0x8c5345f1c1ec4e7e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.285294:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5c2a45600 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:3.0:1782239915.285297:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a45600/0x8c5345f1c1ec4e7e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.285302:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a45600/0x8c5345f1c1ec4e7e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.285310:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xe219b27a (ffff9bb5d0df4e00) 00010000:00010000:3.0:1782239915.285312:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782239915.285316:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a45600/0x8c5345f1c1ec4e7e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.285321:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a45600/0x8c5345f1c1ec4e7e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.285358:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044000/0x8c5345f1c1ec4e70 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e499 expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.285391:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44600/0x8c5345f1c1ec4e85 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e499 expref: 17 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.285411:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9bb5c30e4b00) 00010000:00010000:3.0:1782239915.285413:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782239915.285416:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5c2a44600, rc 0) 00000100:00100000:3.0:1782239915.285489:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5eddf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+17:9672:x1868813737939200:12345-192.168.203.32@tcp:101:rm.0 Request processed in 793us (1405us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239915.285497:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 29 00000100:00100000:1.0:1782239915.297815:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239915.298041:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737939456 00000100:00100000:3.0:1782239915.298055:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737939456 00000100:00100000:3.0:1782239915.298122:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 30 00000100:00100000:3.0:1782239915.298132:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fff01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+17:9672:x1868813737939456:12345-192.168.203.32@tcp:36:rm.0 00010000:00010000:3.0:1782239915.298211:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1782239915.298247:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44600/0x8c5345f1c1ec4e85 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e499 expref: 17 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.298275:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030800/0x8c5345f1c1ec4e31 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e47d expref: 16 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.298289:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9bb5c30e4b00) 00010000:00010000:3.0:1782239915.298307:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044e00/0x8c5345f1c1ec4e46 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e484 expref: 15 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.298316:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9bb5d0df4b00) 00010000:00010000:3.0:1782239915.298319:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782239915.298345:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a45600/0x8c5345f1c1ec4e8c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.298391:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a45600/0x8c5345f1c1ec4e8c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.298402:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a45600/0x8c5345f1c1ec4e8c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.298419:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44200/0x8c5345f1c1ec4e93 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.298425:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44200/0x8c5345f1c1ec4e93 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.298431:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44200/0x8c5345f1c1ec4e93 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.298588:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44c00/0x8c5345f1c1ec4e9a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.298597:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44c00/0x8c5345f1c1ec4e9a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.298604:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44c00/0x8c5345f1c1ec4e9a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782239915.301176:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:3.0:1782239915.301208:0:5792:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 294373458549ns, next at 295373452698ns, rc = 0 00010000:00010000:3.0:1782239915.301329:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44e00/0x8c5345f1c1ec4ea1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.301350:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44e00/0x8c5345f1c1ec4ea1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.301402:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44e00/0x8c5345f1c1ec4ea1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.301413:0:5792:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44e00/0x8c5345f1c1ec4ea1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.301420:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44e00/0x8c5345f1c1ec4ea1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.301427:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44e00/0x8c5345f1c1ec4ea1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.301458:0:5792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782239915.301486:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44c00/0x8c5345f1c1ec4e9a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.301493:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44c00/0x8c5345f1c1ec4e9a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.301500:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44c00/0x8c5345f1c1ec4e9a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.301507:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5c2a44c00 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:3.0:1782239915.301512:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44c00/0x8c5345f1c1ec4e9a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.301521:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44c00/0x8c5345f1c1ec4e9a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.301535:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9bb5d0df4500) 00010000:00010000:3.0:1782239915.301539:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1782239915.301550:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44c00/0x8c5345f1c1ec4e9a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.301557:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44c00/0x8c5345f1c1ec4e9a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.301583:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a45600/0x8c5345f1c1ec4e8c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.301590:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a45600/0x8c5345f1c1ec4e8c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.301596:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a45600/0x8c5345f1c1ec4e8c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.301602:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5c2a45600 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:3.0:1782239915.301605:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a45600/0x8c5345f1c1ec4e8c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.301611:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a45600/0x8c5345f1c1ec4e8c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.301620:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9bb5d0df4b00) 00010000:00010000:3.0:1782239915.301622:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782239915.301625:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a45600/0x8c5345f1c1ec4e8c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.301631:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a45600/0x8c5345f1c1ec4e8c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239915.301891:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782239915.301900:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44e00/0x8c5345f1c1ec4ea1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239915.301907:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5c2a44e00 already unused, calling callback (ffffffffc1728ce0) 00010000:00010000:0.0:1782239915.301910:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44e00/0x8c5345f1c1ec4ea1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239915.301917:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44e00/0x8c5345f1c1ec4ea1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239915.301927:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9bb5d0df4500) 00010000:00010000:0.0:1782239915.301930:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1782239915.301932:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44e00/0x8c5345f1c1ec4ea1 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239915.301947:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44e00/0x8c5345f1c1ec4ea1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239915.301968:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782239915.301970:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782239915.301971:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00010000:3.0:1782239915.302525:0:5792:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000061e024ff reply state 000000002a442e69 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44200/0x8c5345f1c1ec4e93 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239915.302618:0:5792:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782239915.310432:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fff01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+16:9672:x1868813737939456:12345-192.168.203.32@tcp:36:rm.0 Request processed in 12282us (12614us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1782239915.310450:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 30 00000100:00100000:1.0:1782239915.324246:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239915.324358:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737939712 00000100:00100000:3.0:1782239915.324383:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737939712 00000100:00100000:3.0:1782239915.324469:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 5 00000100:00100000:3.0:1782239915.324482:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fff03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+16:9672:x1868813737939712:12345-192.168.203.32@tcp:35:rm.0 00000100:00100000:3.0:1782239915.324894:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fff03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+17:9672:x1868813737939712:12345-192.168.203.32@tcp:35:rm.0 Request processed in 413us (660us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1782239915.324903:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 5 00010000:00010000:2.0:1782239915.325951:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44200/0x8c5345f1c1ec4e93 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239915.325972:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44200/0x8c5345f1c1ec4e93 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239915.325981:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44200/0x8c5345f1c1ec4e93 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239915.325990:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5c2a44200 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:2.0:1782239915.325995:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44200/0x8c5345f1c1ec4e93 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239915.326029:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44200/0x8c5345f1c1ec4e93 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239915.326053:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xe219b27a (ffff9bb5d0df4e00) 00010000:00010000:2.0:1782239915.326056:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782239915.326062:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44200/0x8c5345f1c1ec4e93 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239915.326069:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44200/0x8c5345f1c1ec4e93 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782239915.333061:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239915.333171:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737939968 00000100:00100000:3.0:1782239915.333185:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737939968 00000100:00100000:3.0:1782239915.333261:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 31 00000100:00100000:3.0:1782239915.333273:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5eddf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+16:9672:x1868813737939968:12345-192.168.203.32@tcp:36:rm.0 00010000:00010000:3.0:1782239915.333356:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1782239915.333401:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044a00/0x8c5345f1c1ec4e62 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e492 expref: 16 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.333431:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44a00/0x8c5345f1c1ec4e00 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e46f expref: 15 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.333445:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9bb5d0df4b00) 00010000:00010000:3.0:1782239915.333466:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c1677000/0x8c5345f1c1ec4dc1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e461 expref: 14 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.333477:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bb5c30e4e00) 00010000:00010000:3.0:1782239915.333486:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782239915.333543:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a45600/0x8c5345f1c1ec4ea8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.333560:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a45600/0x8c5345f1c1ec4ea8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.333571:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a45600/0x8c5345f1c1ec4ea8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.333584:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44c00/0x8c5345f1c1ec4eaf lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.333590:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44c00/0x8c5345f1c1ec4eaf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.333596:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44c00/0x8c5345f1c1ec4eaf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.334053:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44600/0x8c5345f1c1ec4eb6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.334063:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44600/0x8c5345f1c1ec4eb6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.334071:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44600/0x8c5345f1c1ec4eb6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782239915.334859:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1782239915.334881:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44600/0x8c5345f1c1ec4eb6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.334890:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44600/0x8c5345f1c1ec4eb6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.334907:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44600/0x8c5345f1c1ec4eb6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.334914:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5c2a44600 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:3.0:1782239915.334920:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44600/0x8c5345f1c1ec4eb6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.334929:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44600/0x8c5345f1c1ec4eb6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.334943:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9bb5d0df4100) 00010000:00010000:3.0:1782239915.334946:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1782239915.334950:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44600/0x8c5345f1c1ec4eb6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.334957:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44600/0x8c5345f1c1ec4eb6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.334985:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a45600/0x8c5345f1c1ec4ea8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.334992:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a45600/0x8c5345f1c1ec4ea8 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.334998:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a45600/0x8c5345f1c1ec4ea8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.335004:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5c2a45600 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:3.0:1782239915.335006:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a45600/0x8c5345f1c1ec4ea8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.335023:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a45600/0x8c5345f1c1ec4ea8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.335032:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bb5d0df4300) 00010000:00010000:3.0:1782239915.335034:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782239915.335037:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a45600/0x8c5345f1c1ec4ea8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239915.335043:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a45600/0x8c5345f1c1ec4ea8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782239915.335055:0:5790:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000027b78759 reply state 000000001953ec1c transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44c00/0x8c5345f1c1ec4eaf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239915.335065:0:5790:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782239915.335178:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5eddf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+15:9672:x1868813737939968:12345-192.168.203.32@tcp:36:rm.0 Request processed in 1903us (2130us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1782239915.335189:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 31 00010000:00010000:2.0:1782239915.346236:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44c00/0x8c5345f1c1ec4eaf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239915.346261:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44c00/0x8c5345f1c1ec4eaf lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239915.346270:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44c00/0x8c5345f1c1ec4eaf lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239915.346277:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5c2a44c00 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:2.0:1782239915.346283:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44c00/0x8c5345f1c1ec4eaf lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239915.346294:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44c00/0x8c5345f1c1ec4eaf lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239915.346318:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9bb5d0df4900) 00010000:00010000:2.0:1782239915.346321:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782239915.346326:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44c00/0x8c5345f1c1ec4eaf lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239915.346354:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44c00/0x8c5345f1c1ec4eaf lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239916.255815:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782239917.290093:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782239917.350688:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000004:00080000:2.0:1782239917.350739:0:7049:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 296422989593ns, next at 297422986412ns, rc = 0 00000100:00100000:0.0:1782239917.351897:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5c513ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1868813758945536:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782239917.351999:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239917.355928:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758945536 00000100:00100000:2.0:1782239917.355948:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758945536 00000100:00100000:2.0:1782239917.356047:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1782239917.356064:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f77f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1868813758945536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782239917.356119:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782239917.356227:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f77f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1868813758945536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 170us (4228us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239917.356235:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:2.0:1782239917.356301:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb5c513ca80 x1868813758945536/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782239933 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782239917.356327:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5c513ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1868813758945536:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1782239917.356411:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782239918.100192:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239918.100248:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239918.100277:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239918.100311:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239918.100541:0:8312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737940352 00000100:00100000:2.0:1782239918.100553:0:8312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737940352 00000100:00100000:2.0:1782239918.100654:0:8312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 59 00000100:00100000:2.0:1782239918.100672:0:8312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fbf25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+5:2346:x1868813737940352:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:2.0:1782239918.100806:0:8312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fbf25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+5:2346:x1868813737940352:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 141us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239918.100815:0:8312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 59 00000100:00080000:2.0:1782239918.100843:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782239918.101091:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737940096 00000100:00100000:3.0:1782239918.101097:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737940096 00000100:00100000:3.0:1782239918.101139:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 250 00000100:00100000:3.0:1782239918.101148:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d0330450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afaefb1a-536b-42a3-a3ff-47200f8611c3+13:2346:x1868813737940096:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:3.0:1782239918.101188:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d0330450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afaefb1a-536b-42a3-a3ff-47200f8611c3+13:2346:x1868813737940096:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 41us (1016us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239918.101196:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 250 00000100:00100000:0.0:1782239918.101340:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737940224 00000100:00100000:0.0:1782239918.101346:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737940224 00000100:00100000:0.0:1782239918.101411:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737940480 00000100:00100000:0.0:1782239918.101415:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737940480 00000100:00100000:0.0:1782239918.101439:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 107 00000100:00100000:0.0:1782239918.101446:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fbf26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+14:2346:x1868813737940224:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:0.0:1782239918.101495:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fbf26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+14:2346:x1868813737940224:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 50us (1217us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239918.101503:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 107 00000100:00100000:0.0:1782239918.101533:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 108 00000100:00100000:0.0:1782239918.101540:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fbf25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f135cc01-3d42-4f2a-80ff-79724f1d3285+5:2346:x1868813737940480:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:0.0:1782239918.101580:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fbf25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f135cc01-3d42-4f2a-80ff-79724f1d3285+5:2346:x1868813737940480:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 41us (1268us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239918.101587:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 108 00000100:00080000:3.0:1782239918.101787:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1782239918.305678:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782239918.370765:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fff01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1868813758945792:0@lo:400:kworker.0 00000100:00100000:1.0:1782239918.370864:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239918.370928:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fff03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1868813758946304:0@lo:400:kworker.0 00000100:00100000:1.0:1782239918.370957:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239918.370995:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782239918.371021:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fff02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1868813758945920:0@lo:400:kworker.0 00000100:00100000:1.0:1782239918.371046:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239918.371149:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fff01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813758946048:0@lo:400:kworker.0 00000100:00100000:3.0:1782239918.371184:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239918.371211:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1782239918.371216:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fff00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3306:1868813758945664:0@lo:400:kworker.0 00000100:00100000:3.0:1782239918.371243:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239918.371261:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fff01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1868813758946176:0@lo:400:kworker.0 00000100:00100000:3.0:1782239918.371278:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239918.371459:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758946304 00000100:00100000:1.0:1782239918.371469:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758946304 00000100:00100000:1.0:1782239918.371545:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758946048 00000100:00100000:1.0:1782239918.371549:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758946048 00000100:00100000:1.0:1782239918.371573:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1782239918.371582:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fff00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1868813758946304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782239918.371652:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fff00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1868813758946304:12345-0@lo:400:kworker.0 Request processed in 70us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239918.371660:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1782239918.371677:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1782239918.371683:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ee2ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1868813758946048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782239918.371717:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ee2ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1868813758946048:12345-0@lo:400:kworker.0 Request processed in 33us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239918.371723:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1782239918.371784:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758945664 00000100:00100000:1.0:1782239918.371788:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758945664 00000100:00100000:1.0:1782239918.371814:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1782239918.371820:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d0333c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:3306:x1868813758945664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782239918.371850:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d0333c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:3306:x1868813758945664:12345-0@lo:400:kworker.0 Request processed in 30us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239918.371856:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00010000:00080000:1.0:1782239918.371908:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb5fff03480 x1868813758946304/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782239934 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782239918.371924:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fff03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1868813758946304:0@lo:400:kworker.0 00000100:00100000:1.0:1782239918.371978:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fff00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3306:1868813758945664:0@lo:400:kworker.0 00010000:00080000:1.0:1782239918.371990:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb5fff01f80 x1868813758946048/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782239934 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782239918.372000:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fff01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813758946048:0@lo:400:kworker.0 00000100:00080000:3.0:1782239918.372084:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782239918.372479:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758945792 00000100:00100000:0.0:1782239918.372487:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758945792 00000100:00100000:0.0:1782239918.372537:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758945920 00000100:00100000:0.0:1782239918.372540:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758945920 00000100:00100000:0.0:1782239918.372566:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758946176 00000100:00100000:0.0:1782239918.372569:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758946176 00000100:00100000:0.0:1782239918.372588:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1782239918.372595:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fff02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1868813758945792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782239918.372669:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fff02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1868813758945792:12345-0@lo:400:kworker.0 Request processed in 75us (1805us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239918.372675:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1782239918.372689:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1782239918.372695:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fff00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1868813758945920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782239918.372724:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fff00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1868813758945920:12345-0@lo:400:kworker.0 Request processed in 29us (1676us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239918.372730:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1782239918.372772:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1782239918.372778:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ee2fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1868813758946176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782239918.372815:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ee2fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1868813758946176:12345-0@lo:400:kworker.0 Request processed in 37us (1535us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239918.372821:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1782239918.372880:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fff02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1868813758945920:0@lo:400:kworker.0 00000100:00100000:0.0:1782239918.372894:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fff01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1868813758945792:0@lo:400:kworker.0 00000100:00080000:0.0:1782239918.372921:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782239918.372939:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fff01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1868813758946176:0@lo:400:kworker.0 00000100:00100000:2.0:1782239918.879396:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782239918.879425:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fbf24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1868813758946432:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782239918.879530:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239918.879764:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758946432 00000100:00100000:0.0:1782239918.879774:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758946432 00000100:00100000:0.0:1782239918.880052:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1782239918.880064:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5c513ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1868813758946432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782239918.880115:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782239918.880232:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5c513ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1868813758946432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 170us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239918.880240:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:3.0:1782239918.884272:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb5fbf24000 x1868813758946432/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782239934 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782239918.884308:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fbf24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1868813758946432:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782239919.330020:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1782239919.972322:0:5812:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967302 is committed 00000004:00080000:0.0:1782239919.972353:0:5812:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:0.0:1782239919.972366:0:5812:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967304 is committed 00000001:00080000:0.0:1782239919.972371:0:5812:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:0.0:1782239919.972377:0:5812:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:0.0:1782239919.972495:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fbf25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813758946560:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1782239919.972555:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239919.972610:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758946560 00000100:00100000:0.0:1782239919.972616:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758946560 00000100:00100000:0.0:1782239919.972666:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1782239919.972699:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fbf24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1868813758946560:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1782239919.972725:0:6590:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:0.0:1782239919.972774:0:6590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a3ad2ab, atime: 0x6a3ad2ab, ctime: 0x6a3ad2ab, blocks: 0x1 00010000:00010000:0.0:1782239919.972783:0:6590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f079b187/0x8c5345f1c1ec4ebd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239919.972809:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=299s v=(0 0) 00010000:00010000:0.0:1782239919.972813:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782239919.972819:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f079b187/0x8c5345f1c1ec4ebd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239919.972836:0:6590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f079b187/0x8c5345f1c1ec4ebd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239919.972845:0:6590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f079b187/0x8c5345f1c1ec4ebd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239919.972853:0:6590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f079b187/0x8c5345f1c1ec4ebd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239919.972869:0:6590:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1782239919.973318:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fbf24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3306:x1868813758946560:12345-0@lo:6:osp-syn-0-0.0 Request processed in 643us (762us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1782239919.973324:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1782239919.973359:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1782239919.973518:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782239919.973529:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f079b187/0x8c5345f1c1ec4ebd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239919.973538:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5c0030c00 already unused, calling callback (ffffffffc1728ce0) 00010000:00010000:0.0:1782239919.973542:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f079b187/0x8c5345f1c1ec4ebd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239919.973567:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f079b187/0x8c5345f1c1ec4ebd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239919.973584:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f079b187/0x8c5345f1c1ec4ebd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239919.973590:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f079b187/0x8c5345f1c1ec4ebd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239919.973608:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782239919.973610:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782239919.973611:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1782239919.974200:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bb5fbf25180/2, rc 0, transno 4294967300 00000100:00100000:0.0:1782239919.974208:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fbf25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813758946560:0@lo:6:osp-syn-0-0.0 00000001:02000400:2.0:1782239920.040010:0:11467:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:3.0:1782239920.351057:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1782239920.589867:0:6614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000020:00000080:2.0:1782239921.225891:0:11517:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdbb7c6c50 20000000:00000080:2.0:1782239921.225908:0:11517:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9bb5f77f6c00 uarg=0000000000000000 20000000:01000000:2.0:1782239921.225943:0:11517:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1782239921.225950:0:11517:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1782239921.225954:0:11517:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:2.0:1782239921.228106:0:11518:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:1.0:1782239921.228391:0:11517:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:1.0:1782239921.241380:0:11517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:1.0:1782239921.241443:0:11517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:1.0:1782239921.241509:0:11517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:1.0:1782239921.241528:0:11517:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1782239921.241548:0:11517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bb5f7e39000/0x8c5345f1c1ec4ec4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239921.241565:0:11517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bb5c2a45e00/0x8c5345f1c1ec4d66 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4d5f expref: 18 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239921.241573:0:11517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bb5c2a44000/0x8c5345f1c1ec4d74 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4d6d expref: 18 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239921.241580:0:11517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bb5c1677c00/0x8c5345f1c1ec4d82 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4d7b expref: 18 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239921.241590:0:11517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bb5c0031800/0x8c5345f1c1ec4d89 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e44c expref: 12 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239921.241608:0:11517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bb5ee29fc00/0x8c5345f1c1ec4d90 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e453 expref: 12 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239921.241616:0:11517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bb5f7e39000/0x8c5345f1c1ec4ec4 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239921.241665:0:11517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bb5ee29fc00/0x8c5345f1c1ec4d90 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e453 expref: 12 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239921.241679:0:11517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bb5ee29fc00/0x8c5345f1c1ec4d90 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e453 expref: 12 pid: 5783 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239921.241694:0:11517:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fff01f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11517:1868813758946688:192.168.203.32@tcp:104: 00010000:00010000:1.0:1782239921.241838:0:11517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bb5c0031800/0x8c5345f1c1ec4d89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e44c expref: 12 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239921.241847:0:11517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bb5c0031800/0x8c5345f1c1ec4d89 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e44c expref: 12 pid: 5783 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239921.241856:0:11517:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fff00000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11517:1868813758946816:192.168.203.32@tcp:104: 00010000:00010000:1.0:1782239921.241889:0:11517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bb5c1677c00/0x8c5345f1c1ec4d82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8c5345f1c1ec4d7b expref: 18 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239921.241897:0:11517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bb5c1677c00/0x8c5345f1c1ec4d82 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8c5345f1c1ec4d7b expref: 18 pid: 5785 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239921.241905:0:11517:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fff03480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11517:1868813758946944:0@lo:104: 00000100:00100000:1.0:1782239921.241945:0:11517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782239921.241980:0:11517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bb5c2a44000/0x8c5345f1c1ec4d74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8c5345f1c1ec4d6d expref: 18 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239921.241988:0:11517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bb5c2a44000/0x8c5345f1c1ec4d74 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8c5345f1c1ec4d6d expref: 18 pid: 5783 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239921.242021:0:11517:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fff01180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11517:1868813758947072:0@lo:104: 00000100:00100000:1.0:1782239921.242044:0:11517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782239921.242065:0:11517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bb5c2a45e00/0x8c5345f1c1ec4d66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8c5345f1c1ec4d5f expref: 18 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239921.242074:0:11517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bb5c2a45e00/0x8c5345f1c1ec4d66 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8c5345f1c1ec4d5f expref: 18 pid: 5785 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239921.242082:0:11517:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fff02300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11517:1868813758947200:0@lo:104: 00000100:00100000:1.0:1782239921.242103:0:11517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239921.242113:0:11517:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c6125780 going to sleep for 11 seconds 00000100:00100000:0.0:1782239921.243353:0:5774:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1782239921.243373:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758946944 00000100:00100000:0.0:1782239921.243381:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758946944 00000100:00100000:0.0:1782239921.243419:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758947072 00000100:00100000:0.0:1782239921.243422:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758947072 00000100:00100000:0.0:1782239921.243434:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758947200 00000100:00100000:0.0:1782239921.243437:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758947200 00000100:00100000:0.0:1782239921.243451:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1782239921.243460:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fff01880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+5:11517:x1868813758946944:12345-0@lo:104: 00010000:00010000:0.0:1782239921.243474:0:5774:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.132@tcp lock: ffff9bb5ee29f600/0x8c5345f1c1ec4d7b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c5345f1c1ec4d82 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239921.243555:0:5774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782239921.243571:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fff01880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+5:11517:x1868813758946944:12345-0@lo:104: Request processed in 113us (1627us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239921.243579:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1782239921.243607:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1782239921.243614:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fff02d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+4:11517:x1868813758947072:12345-0@lo:104: 00010000:00010000:0.0:1782239921.243621:0:5774:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.132@tcp lock: ffff9bb5ee29e200/0x8c5345f1c1ec4d6d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c5345f1c1ec4d74 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239921.243658:0:5774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1782239921.243663:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fff02d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+4:11517:x1868813758947072:12345-0@lo:104: Request processed in 51us (1618us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239921.243668:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1782239921.243680:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1782239921.243686:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f4422850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+3:11517:x1868813758947200:12345-0@lo:104: 00010000:00010000:0.0:1782239921.243693:0:5774:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.132@tcp lock: ffff9bb5c1676600/0x8c5345f1c1ec4d5f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c5345f1c1ec4d66 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239921.243729:0:5774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1782239921.243734:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f4422850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+3:11517:x1868813758947200:12345-0@lo:104: Request processed in 49us (1631us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239921.243740:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:0.0:1782239921.243796:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1782239921.243802:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.132@tcp lock: ffff9bb5ee29f600/0x8c5345f1c1ec4d7b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c5345f1c1ec4d82 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239921.243811:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5ee29f600 already unused, calling callback (ffffffffc1d0cc20) 10000000:00010000:0.0:1782239921.243815:0:5779:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.132@tcp lock: ffff9bb5ee29f600/0x8c5345f1c1ec4d7b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8c5345f1c1ec4d82 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239921.243834:0:5779:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.132@tcp lock: ffff9bb5ee29f600/0x8c5345f1c1ec4d7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8c5345f1c1ec4d82 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782239921.243841:0:5779:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.132@tcp lock: ffff9bb5ee29f600/0x8c5345f1c1ec4d7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8c5345f1c1ec4d82 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782239921.243847:0:5779:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1782239921.243877:0:5779:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.132@tcp lock: ffff9bb5ee29f600/0x8c5345f1c1ec4d7b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c5345f1c1ec4d82 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239921.243884:0:5779:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782239921.243901:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.132@tcp lock: ffff9bb5ee29f600/0x8c5345f1c1ec4d7b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c5345f1c1ec4d82 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239921.243908:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.132@tcp lock: ffff9bb5ee29f600/0x8c5345f1c1ec4d7b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c5345f1c1ec4d82 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239921.243921:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782239921.243923:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.132@tcp lock: ffff9bb5ee29e200/0x8c5345f1c1ec4d6d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c5345f1c1ec4d74 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239921.243929:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5ee29e200 already unused, calling callback (ffffffffc1d0cc20) 10000000:00010000:0.0:1782239921.243931:0:5779:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.132@tcp lock: ffff9bb5ee29e200/0x8c5345f1c1ec4d6d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8c5345f1c1ec4d74 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239921.243937:0:5779:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.132@tcp lock: ffff9bb5ee29e200/0x8c5345f1c1ec4d6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8c5345f1c1ec4d74 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782239921.243943:0:5779:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.132@tcp lock: ffff9bb5ee29e200/0x8c5345f1c1ec4d6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8c5345f1c1ec4d74 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782239921.243954:0:5779:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1782239921.243968:0:5779:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.132@tcp lock: ffff9bb5ee29e200/0x8c5345f1c1ec4d6d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c5345f1c1ec4d74 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239921.243975:0:5779:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782239921.243992:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.132@tcp lock: ffff9bb5ee29e200/0x8c5345f1c1ec4d6d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c5345f1c1ec4d74 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239921.244074:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.132@tcp lock: ffff9bb5ee29e200/0x8c5345f1c1ec4d6d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c5345f1c1ec4d74 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239921.244083:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782239921.244086:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.132@tcp lock: ffff9bb5c1676600/0x8c5345f1c1ec4d5f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c5345f1c1ec4d66 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239921.244091:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5c1676600 already unused, calling callback (ffffffffc1d0cc20) 10000000:00010000:0.0:1782239921.244093:0:5779:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.132@tcp lock: ffff9bb5c1676600/0x8c5345f1c1ec4d5f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8c5345f1c1ec4d66 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239921.244099:0:5779:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.132@tcp lock: ffff9bb5c1676600/0x8c5345f1c1ec4d5f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8c5345f1c1ec4d66 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782239921.244105:0:5779:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.132@tcp lock: ffff9bb5c1676600/0x8c5345f1c1ec4d5f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8c5345f1c1ec4d66 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782239921.244110:0:5779:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1782239921.244122:0:5779:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.132@tcp lock: ffff9bb5c1676600/0x8c5345f1c1ec4d5f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c5345f1c1ec4d66 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239921.244128:0:5779:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782239921.244141:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.132@tcp lock: ffff9bb5c1676600/0x8c5345f1c1ec4d5f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c5345f1c1ec4d66 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239921.244147:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.132@tcp lock: ffff9bb5c1676600/0x8c5345f1c1ec4d5f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c5345f1c1ec4d66 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239921.244159:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782239921.244161:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782239921.244163:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782239921.244335:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5e8ec8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3307:1868813758947328:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782239921.244375:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239921.244422:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5e8eca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3304:1868813758947456:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782239921.244445:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239921.244460:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782239921.244464:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5e8ec9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3304:1868813758947584:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782239921.244481:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239921.244514:0:7481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758947328 00000100:00100000:0.0:1782239921.244518:0:7481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758947328 00010000:00010000:0.0:1782239921.244536:0:7481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bb5c1677c00/0x8c5345f1c1ec4d82 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c5345f1c1ec4d7b expref: 19 pid: 5785 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782239921.244553:0:7481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758947456 00000100:00100000:0.0:1782239921.244556:0:7481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758947456 00010000:00010000:0.0:1782239921.244564:0:7481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bb5c2a44000/0x8c5345f1c1ec4d74 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c5345f1c1ec4d6d expref: 20 pid: 5783 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782239921.244573:0:7481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758947584 00000100:00100000:0.0:1782239921.244575:0:7481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758947584 00010000:00010000:0.0:1782239921.244582:0:7481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bb5c2a45e00/0x8c5345f1c1ec4d66 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c5345f1c1ec4d5f expref: 21 pid: 5785 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782239921.244621:0:7481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1782239921.244627:0:7481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8ec9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+21:3307:x1868813758947328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782239921.244638:0:7481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782239921.244642:0:7481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bb5c1677c00/0x8c5345f1c1ec4d82 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c5345f1c1ec4d7b expref: 21 pid: 5785 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239921.244652:0:7481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bb5c1677c00/0x8c5345f1c1ec4d82 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8c5345f1c1ec4d7b expref: 21 pid: 5785 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239921.244668:0:7481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782239921.244693:0:7481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8ec9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+21:3307:x1868813758947328:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239921.244698:0:7481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1782239921.244709:0:7481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1782239921.244715:0:7481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8eca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+20:3304:x1868813758947456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782239921.244721:0:7481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782239921.244725:0:7481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bb5c2a44000/0x8c5345f1c1ec4d74 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c5345f1c1ec4d6d expref: 20 pid: 5783 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239921.244733:0:7481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bb5c2a44000/0x8c5345f1c1ec4d74 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8c5345f1c1ec4d6d expref: 20 pid: 5783 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239921.244741:0:7481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782239921.244789:0:7481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8eca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+20:3304:x1868813758947456:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239921.244794:0:7481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1782239921.244805:0:7481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1782239921.244817:0:7481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d0218c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:3304:x1868813758947584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782239921.244825:0:7481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782239921.244829:0:7481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bb5c2a45e00/0x8c5345f1c1ec4d66 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c5345f1c1ec4d5f expref: 19 pid: 5785 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239921.244837:0:7481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bb5c2a45e00/0x8c5345f1c1ec4d66 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8c5345f1c1ec4d5f expref: 19 pid: 5785 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239921.244846:0:7481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782239921.244866:0:7481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d0218c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:3304:x1868813758947584:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239921.244872:0:7481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1782239921.244933:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5e8ec9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3304:1868813758947584:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782239921.244941:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5e8eca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3304:1868813758947456:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782239921.244962:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5e8ec8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3307:1868813758947328:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782239921.245193:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782239921.246215:0:11517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb5c1677c00/0x8c5345f1c1ec4d82 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8c5345f1c1ec4d7b expref: 18 pid: 5785 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239921.246237:0:11517:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fff03480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11517:1868813758946944:0@lo:104: 00010000:00010000:1.0:1782239921.246250:0:11517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb5c2a44000/0x8c5345f1c1ec4d74 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8c5345f1c1ec4d6d expref: 17 pid: 5783 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239921.246258:0:11517:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fff01180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11517:1868813758947072:0@lo:104: 00010000:00010000:1.0:1782239921.246268:0:11517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb5c2a45e00/0x8c5345f1c1ec4d66 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8c5345f1c1ec4d5f expref: 16 pid: 5785 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239921.246276:0:11517:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fff02300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11517:1868813758947200:0@lo:104: 00000100:00100000:0.0:1782239921.246593:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239921.246679:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239921.247079:0:7481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737940608 00000100:00100000:3.0:1782239921.247087:0:7481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737940608 00010000:00010000:3.0:1782239921.247136:0:7481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bb5ee29fc00/0x8c5345f1c1ec4d90 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e453 expref: 13 pid: 5783 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239921.247238:0:11517:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fff01f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11517:1868813758946688:192.168.203.32@tcp:104: 00000100:00100000:1.0:1782239921.247249:0:11517:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fff00000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11517:1868813758946816:192.168.203.32@tcp:104: 00010000:00010000:1.0:1782239921.247284:0:11517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bb5f7e39000/0x8c5345f1c1ec4ec4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239921.248198:0:7481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737940736 00000100:00100000:3.0:1782239921.248206:0:7481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737940736 00010000:00010000:3.0:1782239921.248230:0:7481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bb5c0031800/0x8c5345f1c1ec4d89 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e44c expref: 14 pid: 5783 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239921.248262:0:7481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 33 00000100:00100000:3.0:1782239921.248270:0:7481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8ec8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:afaefb1a-536b-42a3-a3ff-47200f8611c3+14:2344:x1868813737940608:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782239921.248283:0:7481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782239921.248288:0:7481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bb5ee29fc00/0x8c5345f1c1ec4d90 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e453 expref: 14 pid: 5783 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239921.248317:0:7481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bb5ee29fc00/0x8c5345f1c1ec4d90 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e453 expref: 14 pid: 5783 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239921.248342:0:7481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb5ee29fc00/0x8c5345f1c1ec4d90 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e453 expref: 14 pid: 5783 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239921.248355:0:7481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782239921.248462:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 34 00000100:00100000:2.0:1782239921.248475:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8eca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:afaefb1a-536b-42a3-a3ff-47200f8611c3+13:2344:x1868813737940736:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782239921.248483:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782239921.248488:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bb5c0031800/0x8c5345f1c1ec4d89 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e44c expref: 13 pid: 5783 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239921.248496:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bb5c0031800/0x8c5345f1c1ec4d89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e44c expref: 13 pid: 5783 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239921.248507:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb5c0031800/0x8c5345f1c1ec4d89 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e44c expref: 13 pid: 5783 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239921.248519:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bb5f7e39000/0x8c5345f1c1ec4ec4 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239921.248528:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb5f7e39000/0x8c5345f1c1ec4ec4 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239921.248542:0:5776:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bb5f7e39000/0x8c5345f1c1ec4ec4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239921.248559:0:5776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bb5f7e39000/0x8c5345f1c1ec4ec4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239921.248565:0:5776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bb5f7e39000/0x8c5345f1c1ec4ec4 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239921.248571:0:5776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bb5f7e39000/0x8c5345f1c1ec4ec4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239921.248578:0:5776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f7e39000 already unused, calling callback (ffffffffc1728ce0) 00010000:00010000:2.0:1782239921.248582:0:5776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bb5f7e39000/0x8c5345f1c1ec4ec4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239921.248591:0:5776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bb5f7e39000/0x8c5345f1c1ec4ec4 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239921.248618:0:5776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bb5f7e39000/0x8c5345f1c1ec4ec4 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239921.248628:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782239921.248671:0:7481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8ec8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:afaefb1a-536b-42a3-a3ff-47200f8611c3+12:2344:x1868813737940608:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 399us (2078us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239921.248680:0:7481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 33 00010000:00010000:0.0:1782239921.250221:0:11517:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bb5f7e39000/0x8c5345f1c1ec4ec4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239921.250236:0:11517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bb5f7e39000/0x8c5345f1c1ec4ec4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239921.250243:0:11517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb5f7e39000/0x8c5345f1c1ec4ec4 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239921.254222:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8eca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:afaefb1a-536b-42a3-a3ff-47200f8611c3+11:2344:x1868813737940736:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 1124us (2916us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239921.254240:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 34 00010000:00010000:0.0:1782239921.377286:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782239922.399178:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782239922.463096:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782239922.463119:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5c513f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1868813758947712:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782239922.463188:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239922.463434:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758947712 00000100:00100000:2.0:1782239922.463442:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758947712 00000100:00100000:2.0:1782239922.463560:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1782239922.463572:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fff00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1868813758947712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782239922.463617:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782239922.463665:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fff00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1868813758947712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239922.463685:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1782239922.464115:0:3307:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:3.0:1782239922.464121:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bb5fbf25180, transno 4294967300 00000100:00100000:3.0:1782239922.464147:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5c513f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1868813758947712:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1782239922.472624:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782239922.900376:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239922.900569:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737940864 00000100:00100000:3.0:1782239922.900579:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737940864 00000100:00100000:3.0:1782239922.900694:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 252 00000100:00100000:3.0:1782239922.900704:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d0333850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afaefb1a-536b-42a3-a3ff-47200f8611c3+11:5567:x1868813737940864:12345-192.168.203.32@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782239922.900721:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782239922.900739:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb5c2a44600/0x8c5345f1c1ec4ecb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e4a0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239922.900867:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb5c2a44600/0x8c5345f1c1ec4ecb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e4a0 expref: 12 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239922.900879:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb5c2a44600/0x8c5345f1c1ec4ecb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e4a0 expref: 12 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239922.900906:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5c2a44600, rc 0) 00000100:00100000:3.0:1782239922.900964:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d0333850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afaefb1a-536b-42a3-a3ff-47200f8611c3+12:5567:x1868813737940864:12345-192.168.203.32@tcp:101:ll_cfg_requeue.0 Request processed in 261us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239922.900972:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 252 00000100:00100000:1.0:1782239922.903155:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239922.903230:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737940992 00000100:00100000:3.0:1782239922.903241:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737940992 00000100:00100000:3.0:1782239922.903304:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 253 00000100:00100000:3.0:1782239922.903322:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d0332050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afaefb1a-536b-42a3-a3ff-47200f8611c3+12:5567:x1868813737940992:12345-192.168.203.32@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782239922.903633:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d0332050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afaefb1a-536b-42a3-a3ff-47200f8611c3+12:5567:x1868813737940992:12345-192.168.203.32@tcp:501:ll_cfg_requeue.0 Request processed in 320us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239922.903642:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 253 00000100:00100000:0.0:1782239922.909188:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239922.909357:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737941120 00000100:00100000:3.0:1782239922.909367:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737941120 00000100:00100000:3.0:1782239922.909481:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 254 00000100:00100000:3.0:1782239922.909503:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d0333450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afaefb1a-536b-42a3-a3ff-47200f8611c3+12:5567:x1868813737941120:12345-192.168.203.32@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782239922.909727:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d0333450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afaefb1a-536b-42a3-a3ff-47200f8611c3+12:5567:x1868813737941120:12345-192.168.203.32@tcp:503:ll_cfg_requeue.0 Request processed in 236us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239922.909736:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 254 00000100:00100000:2.0:1782239922.917859:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239922.918446:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737941248 00000100:00100000:1.0:1782239922.918461:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737941248 00000100:00100000:1.0:1782239922.918536:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 255 00000100:00100000:1.0:1782239922.918549:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d0332450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afaefb1a-536b-42a3-a3ff-47200f8611c3+12:9942:x1868813737941248:12345-192.168.203.32@tcp:502:llog_process_th.0 00000100:00100000:1.0:1782239922.919036:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d0332450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afaefb1a-536b-42a3-a3ff-47200f8611c3+12:9942:x1868813737941248:12345-192.168.203.32@tcp:502:llog_process_th.0 Request processed in 487us (1191us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239922.919047:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 255 00000100:00100000:0.0:1782239922.925664:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239922.925951:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737941376 00000100:00100000:3.0:1782239922.925965:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737941376 00000100:00100000:3.0:1782239922.926040:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 256 00000100:00100000:3.0:1782239922.926051:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5c886b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afaefb1a-536b-42a3-a3ff-47200f8611c3+12:9942:x1868813737941376:12345-192.168.203.32@tcp:502:llog_process_th.0 00000100:00100000:3.0:1782239922.926464:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5c886b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afaefb1a-536b-42a3-a3ff-47200f8611c3+12:9942:x1868813737941376:12345-192.168.203.32@tcp:502:llog_process_th.0 Request processed in 413us (814us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239922.926483:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 256 00000100:00100000:0.0:1782239922.933087:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239922.935261:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737941504 00000100:00100000:3.0:1782239922.935492:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737941504 00000100:00100000:3.0:1782239922.935648:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 257 00000100:00100000:3.0:1782239922.935660:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5c886a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afaefb1a-536b-42a3-a3ff-47200f8611c3+12:5567:x1868813737941504:12345-192.168.203.32@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782239922.936414:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782239922.936447:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb5c2a45600/0x8c5345f1c1ec4ed2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e4a7 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239922.936489:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb5c2a45600/0x8c5345f1c1ec4ed2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e4a7 expref: 13 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239922.936503:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb5c2a45600/0x8c5345f1c1ec4ed2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e4a7 expref: 13 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239922.936515:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5c2a45600, rc 0) 00000100:00100000:3.0:1782239922.936622:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5c886a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afaefb1a-536b-42a3-a3ff-47200f8611c3+13:5567:x1868813737941504:12345-192.168.203.32@tcp:101:ll_cfg_requeue.0 Request processed in 963us (3547us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239922.936631:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 257 00000100:00100000:2.0:1782239922.941538:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239922.941666:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737941632 00000100:00100000:1.0:1782239922.941680:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737941632 00000100:00100000:0.0:1782239922.943728:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 258 00000100:00100000:0.0:1782239922.943799:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5c8869850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afaefb1a-536b-42a3-a3ff-47200f8611c3+13:5567:x1868813737941632:12345-192.168.203.32@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782239922.944463:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5c8869850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afaefb1a-536b-42a3-a3ff-47200f8611c3+13:5567:x1868813737941632:12345-192.168.203.32@tcp:501:ll_cfg_requeue.0 Request processed in 716us (2937us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239922.944472:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 258 00000100:00100000:1.0:1782239922.949451:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239922.951395:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737941760 00000100:00100000:0.0:1782239922.951416:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737941760 00000100:00100000:0.0:1782239922.952079:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 259 00000100:00100000:0.0:1782239922.952094:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5c886a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afaefb1a-536b-42a3-a3ff-47200f8611c3+13:5567:x1868813737941760:12345-192.168.203.32@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782239922.954378:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5c886a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afaefb1a-536b-42a3-a3ff-47200f8611c3+13:5567:x1868813737941760:12345-192.168.203.32@tcp:503:ll_cfg_requeue.0 Request processed in 2271us (5020us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239922.954398:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 259 00000100:00100000:1.0:1782239922.960043:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239922.960276:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737941888 00000100:00100000:3.0:1782239922.960300:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737941888 00000100:00100000:3.0:1782239922.960389:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 260 00000100:00100000:3.0:1782239922.960402:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5c8868850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afaefb1a-536b-42a3-a3ff-47200f8611c3+13:9945:x1868813737941888:12345-192.168.203.32@tcp:502:llog_process_th.0 00000100:00100000:3.0:1782239922.960794:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5c8868850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afaefb1a-536b-42a3-a3ff-47200f8611c3+13:9945:x1868813737941888:12345-192.168.203.32@tcp:502:llog_process_th.0 Request processed in 393us (764us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239922.960804:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 260 00000100:00100000:2.0:1782239922.967276:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239922.967530:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737942016 00000100:00100000:0.0:1782239922.967544:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737942016 00000100:00100000:0.0:1782239922.967726:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 261 00000100:00100000:0.0:1782239922.967828:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5c886ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afaefb1a-536b-42a3-a3ff-47200f8611c3+13:9945:x1868813737942016:12345-192.168.203.32@tcp:502:llog_process_th.0 00000100:00100000:0.0:1782239922.968422:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5c886ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afaefb1a-536b-42a3-a3ff-47200f8611c3+13:9945:x1868813737942016:12345-192.168.203.32@tcp:502:llog_process_th.0 Request processed in 663us (1151us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239922.968433:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 261 10000000:01000000:0.0:1782239923.167488:0:5787:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1782239923.167500:0:5787:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9bb5eddbf000 from 7 10000000:01000000:0.0:1782239923.167507:0:5787:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1782239923.167582:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5c0031800/0x8c5345f1c1ec4ed9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239923.167620:0:5787:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: ffff9bb5c0031800/0x8c5345f1c1ec4ed9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239923.167634:0:5787:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff9bb5c0031800/0x8c5345f1c1ec4ed9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782239923.167668:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5e8ec9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758947840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782239923.167805:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239923.167882:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb601a10480 going to sleep for 11 seconds 00000100:00100000:3.0:1782239923.169063:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758947840 00000100:00100000:3.0:1782239923.169086:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758947840 00000100:00100000:3.0:1782239923.169172:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1782239923.169184:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5c8869050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+16:5787:x1868813758947840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782239923.169206:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782239923.169229:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb5c2a44a00/0x8c5345f1c1ec4ee0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c5345f1c1ec4ed9 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239923.169265:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb5c2a44a00/0x8c5345f1c1ec4ee0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4ed9 expref: 17 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239923.169287:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb5c2a44a00/0x8c5345f1c1ec4ee0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4ed9 expref: 17 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239923.169299:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5c2a44a00, rc 0) 00000100:00100000:3.0:1782239923.169418:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5c8869050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+17:5787:x1868813758947840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 235us (1612us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239923.169427:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1782239923.169465:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5e8ec9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758947840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782239923.169488:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff9bb5c0031800/0x8c5345f1c1ec4ed9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4ee0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239923.169498:0:5787:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff9bb5c0031800/0x8c5345f1c1ec4ed9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c5345f1c1ec4ee0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782239923.169578:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5e8ec9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758947968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782239923.169614:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239923.169658:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb601a10480 going to sleep for 11 seconds 00000100:00100000:1.0:1782239923.169722:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758947968 00000100:00100000:1.0:1782239923.169727:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758947968 00000100:00100000:1.0:1782239923.169774:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1782239923.169780:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5c8869450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+17:5787:x1868813758947968:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782239923.170605:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5c8869450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+17:5787:x1868813758947968:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 821us (987us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239923.170627:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1782239923.171106:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5e8ec9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758947968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782239923.171160:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5e8ec9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758948096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782239923.171218:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239923.171446:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb601a10480 going to sleep for 11 seconds 00000100:00100000:3.0:1782239923.172857:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758948096 00000100:00100000:3.0:1782239923.172874:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758948096 00000100:00100000:3.0:1782239923.173078:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1782239923.173090:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8d76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+17:5787:x1868813758948096:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782239923.173428:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8d76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+17:5787:x1868813758948096:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 340us (2208us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239923.173436:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1782239923.173553:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5e8ec9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758948096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782239923.174876:0:11530:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5e8ec9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:11530:1868813758948224:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782239923.174978:0:11530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239923.185196:0:11530:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb601a10900 going to sleep for 11 seconds 00000100:00100000:2.0:1782239923.192736:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758948224 00000100:00100000:2.0:1782239923.192776:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758948224 00000100:00100000:2.0:1782239923.192905:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1782239923.193082:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8d75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+17:11530:x1868813758948224:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782239923.193496:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8d75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+17:11530:x1868813758948224:12345-0@lo:502:llog_process_th.0 Request processed in 416us (18516us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239923.193506:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1782239923.195126:0:11530:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5e8ec9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:11530:1868813758948224:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1782239923.195205:0:11530:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782239923.195223:0:11530:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782239923.195226:0:11530:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1782239923.195235:0:11530:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9bb5eddbf000 00000020:00000080:0.0:1782239923.195239:0:11530:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1782239923.195406:0:11530:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5e8ec9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:11530:1868813758948352:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782239923.195869:0:11530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239923.196027:0:11530:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb601a10900 going to sleep for 11 seconds 00000100:00100000:0.0:1782239923.196076:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758948352 00000100:00100000:0.0:1782239923.196085:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758948352 00000100:00100000:0.0:1782239923.196135:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1782239923.196144:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8d76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+17:11530:x1868813758948352:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782239923.199045:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8d76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+17:11530:x1868813758948352:12345-0@lo:502:llog_process_th.0 Request processed in 2440us (2715us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239923.199066:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1782239923.199237:0:11530:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5e8ec9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:11530:1868813758948352:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1782239923.199294:0:11530:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782239923.199306:0:11530:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782239923.199309:0:11530:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1782239923.199323:0:11530:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1782239923.200122:0:5787:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1782239923.200148:0:5787:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1782239923.200162:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5c0031800/0x8c5345f1c1ec4ed9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4ee0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239923.200176:0:5787:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff9bb5c0031800/0x8c5345f1c1ec4ed9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4ee0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782239923.200190:0:5787:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1782239923.200209:0:5787:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9bb5c8863000 from 7 10000000:01000000:0.0:1782239923.200213:0:5787:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1782239923.200261:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5c0030c00/0x8c5345f1c1ec4ee7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239923.200271:0:5787:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: ffff9bb5c0030c00/0x8c5345f1c1ec4ee7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239923.200295:0:5787:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff9bb5c0030c00/0x8c5345f1c1ec4ee7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782239923.200340:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5e8ec9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758948480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782239923.200417:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239923.200471:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb601a10840 going to sleep for 11 seconds 00000100:00100000:3.0:1782239923.201079:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758948480 00000100:00100000:3.0:1782239923.201091:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758948480 00000100:00100000:3.0:1782239923.201154:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1782239923.201164:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8d74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+17:5787:x1868813758948480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782239923.201196:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782239923.201218:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb5c2a45e00/0x8c5345f1c1ec4eee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c5345f1c1ec4ee7 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239923.201250:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb5c2a45e00/0x8c5345f1c1ec4eee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4ee7 expref: 18 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239923.201264:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb5c2a45e00/0x8c5345f1c1ec4eee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4ee7 expref: 18 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239923.201275:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5c2a45e00, rc 0) 00000100:00100000:3.0:1782239923.201362:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8d74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+18:5787:x1868813758948480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 199us (945us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239923.201371:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1782239923.202008:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5e8ec9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758948480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782239923.202032:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff9bb5c0030c00/0x8c5345f1c1ec4ee7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4eee expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239923.202042:0:5787:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff9bb5c0030c00/0x8c5345f1c1ec4ee7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c5345f1c1ec4eee expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239923.202127:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5c513ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758948608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782239923.202176:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239923.202231:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5d1cd0d80 going to sleep for 11 seconds 00000100:00100000:0.0:1782239923.202321:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758948608 00000100:00100000:0.0:1782239923.202334:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758948608 00000100:00100000:0.0:1782239923.202379:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1782239923.202388:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8d76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+18:5787:x1868813758948608:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782239923.204377:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8d76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+18:5787:x1868813758948608:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1887us (2098us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239923.204392:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1782239923.204523:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5c513ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758948608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782239923.204981:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5c513ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758948736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782239923.205044:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239923.205091:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5d1cd0d80 going to sleep for 11 seconds 00000100:00100000:3.0:1782239923.205456:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758948736 00000100:00100000:3.0:1782239923.205464:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758948736 00000100:00100000:3.0:1782239923.205522:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1782239923.205532:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8d75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+18:5787:x1868813758948736:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782239923.206204:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8d75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+18:5787:x1868813758948736:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 671us (1157us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239923.206213:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1782239923.206880:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5c513ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758948736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782239923.209147:0:11532:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5ee2fdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:11532:1868813758948864:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782239923.209268:0:11532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239923.209348:0:11532:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5d1342d80 going to sleep for 11 seconds 00000100:00100000:1.0:1782239923.212338:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758948864 00000100:00100000:1.0:1782239923.212362:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758948864 00000100:00100000:1.0:1782239923.212568:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1782239923.212825:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8d75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+18:11532:x1868813758948864:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782239923.213218:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8d75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+18:11532:x1868813758948864:12345-0@lo:502:llog_process_th.0 Request processed in 400us (3950us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239923.213325:0:11532:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5ee2fdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:11532:1868813758948864:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782239923.213394:0:11532:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782239923.213409:0:11532:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782239923.213420:0:11532:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1782239923.213430:0:11532:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9bb5c8863000 00000020:00000080:3.0:1782239923.213432:0:11532:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1782239923.213552:0:11532:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5ee2fdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:11532:1868813758948992:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782239923.213624:0:11532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239923.213657:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758948992 00000100:00100000:3.0:1782239923.213662:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758948992 00000100:00100000:2.0:1782239923.214845:0:11532:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5d1342d80 going to sleep for 11 seconds 00000100:00100000:1.0:1782239923.214911:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1782239923.223105:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1782239923.223142:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8d77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+18:11532:x1868813758948992:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782239923.223858:0:11532:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5ee2fdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:11532:1868813758948992:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1782239923.223910:0:11532:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782239923.223920:0:11532:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782239923.223922:0:11532:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1782239923.223927:0:11532:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1782239923.224010:0:5787:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1782239923.224038:0:5787:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1782239923.224053:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5c0030c00/0x8c5345f1c1ec4ee7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4eee expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239923.224067:0:5787:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff9bb5c0030c00/0x8c5345f1c1ec4ee7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4eee expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782239923.224081:0:5787:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1782239923.224084:0:5787:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9bb5c8415000 from 7 10000000:01000000:2.0:1782239923.224087:0:5787:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1782239923.224131:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5ee29f800/0x8c5345f1c1ec4ef5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239923.224152:0:5787:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: ffff9bb5ee29f800/0x8c5345f1c1ec4ef5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239923.224176:0:5787:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff9bb5ee29f800/0x8c5345f1c1ec4ef5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239923.224204:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5c513ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758949120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782239923.224377:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239923.224648:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758949120 00000100:00100000:1.0:1782239923.224658:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758949120 00000100:00100000:2.0:1782239923.224666:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5d1cd0d80 going to sleep for 11 seconds 00000100:00100000:1.0:1782239923.224714:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1782239923.224725:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8d75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:5787:x1868813758949120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782239923.224746:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782239923.224792:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb5f7e39a00/0x8c5345f1c1ec4efc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c5345f1c1ec4ef5 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239923.224826:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb5f7e39a00/0x8c5345f1c1ec4efc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4ef5 expref: 20 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239923.224839:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb5f7e39a00/0x8c5345f1c1ec4efc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c5345f1c1ec4ef5 expref: 20 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239923.224850:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5f7e39a00, rc 0) 00000100:00100000:1.0:1782239923.224902:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8d75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+20:5787:x1868813758949120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 178us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239923.224911:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1782239923.224953:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5c513ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758949120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782239923.224971:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff9bb5ee29f800/0x8c5345f1c1ec4ef5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4efc expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239923.224982:0:5787:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff9bb5ee29f800/0x8c5345f1c1ec4ef5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c5345f1c1ec4efc expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239923.225045:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5c513ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758949248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782239923.225076:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239923.225101:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5d1cd0d80 going to sleep for 11 seconds 00000100:00100000:1.0:1782239923.225187:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758949248 00000100:00100000:1.0:1782239923.225193:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758949248 00000100:00100000:1.0:1782239923.225228:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1782239923.225235:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8d74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+20:5787:x1868813758949248:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782239923.225571:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8d74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+20:5787:x1868813758949248:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 334us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239923.225587:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1782239923.227031:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8d77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:11532:x1868813758948992:12345-0@lo:502:llog_process_th.0 Request processed in 461us (9959us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239923.227049:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1782239923.227941:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5c513ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758949248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782239923.228015:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5ee2ff800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758949376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782239923.228212:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239923.228261:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5d1342900 going to sleep for 11 seconds 00000100:00100000:3.0:1782239923.229862:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758949376 00000100:00100000:3.0:1782239923.229880:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758949376 00000100:00100000:3.0:1782239923.229958:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1782239923.229971:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8d74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:5787:x1868813758949376:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782239923.230771:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8d74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:5787:x1868813758949376:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 776us (2533us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239923.230783:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1782239923.230997:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5ee2ff800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:5787:1868813758949376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782239923.231680:0:11534:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5ee2fc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:11534:1868813758949504:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782239923.231743:0:11534:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239923.232022:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758949504 00000100:00100000:2.0:1782239923.232030:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758949504 00000100:00100000:2.0:1782239923.232078:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1782239923.232088:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8d74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:11534:x1868813758949504:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782239923.232887:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8d74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:11534:x1868813758949504:12345-0@lo:502:llog_process_th.0 Request processed in 797us (1140us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239923.232898:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1782239923.232962:0:11534:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5d1342900 going to sleep for 11 seconds 00000100:00100000:2.0:1782239923.232994:0:11534:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5ee2fc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:11534:1868813758949504:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1782239923.233028:0:11534:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782239923.233041:0:11534:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782239923.233044:0:11534:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1782239923.233053:0:11534:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9bb5c8415000 00000020:00000080:2.0:1782239923.233055:0:11534:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1782239923.233542:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239923.233895:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239923.233925:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239923.233956:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239923.233990:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737942272 00000100:00100000:2.0:1782239923.234049:0:11534:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5c513c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:11534:1868813758949632:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782239923.234104:0:11534:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239923.234135:0:11534:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5d1cd0780 going to sleep for 11 seconds 00000100:00100000:1.0:1782239923.234389:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737942272 00000100:00100000:1.0:1782239923.234465:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737942528 00000100:00100000:1.0:1782239923.234470:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737942528 00000100:00100000:1.0:1782239923.234495:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 112 00000100:00100000:1.0:1782239923.234505:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fff01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+5:2345:x1868813737942272:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:1.0:1782239923.234582:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fff01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+5:2345:x1868813737942272:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 78us (1043us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239923.234590:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 112 00000100:00080000:2.0:1782239923.234798:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782239923.234910:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737942144 00000100:00100000:3.0:1782239923.234916:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737942144 00000100:00100000:3.0:1782239923.234952:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758949632 00000100:00100000:3.0:1782239923.234954:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758949632 00000100:00100000:3.0:1782239923.234968:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 276 00000100:00100000:3.0:1782239923.234975:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8d77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afaefb1a-536b-42a3-a3ff-47200f8611c3+13:2345:x1868813737942144:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:3.0:1782239923.235008:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8d77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afaefb1a-536b-42a3-a3ff-47200f8611c3+13:2345:x1868813737942144:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 33us (1082us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239923.235014:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 276 00000100:00100000:3.0:1782239923.235033:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1782239923.235039:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8d77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:11534:x1868813758949632:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782239923.235220:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 113 00000100:00100000:1.0:1782239923.235231:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fff02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f135cc01-3d42-4f2a-80ff-79724f1d3285+5:2345:x1868813737942528:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:1.0:1782239923.235275:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fff02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f135cc01-3d42-4f2a-80ff-79724f1d3285+5:2345:x1868813737942528:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 37us (1370us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239923.235284:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 113 00000100:00100000:1.0:1782239923.235326:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737942400 00000100:00100000:1.0:1782239923.235330:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737942400 00000100:00100000:3.0:1782239923.235358:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8d77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:11534:x1868813758949632:12345-0@lo:502:llog_process_th.0 Request processed in 317us (1252us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239923.235367:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1782239923.235382:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 62 00000100:00100000:1.0:1782239923.235391:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fff01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+5:2345:x1868813737942400:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:1.0:1782239923.235418:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fff01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+5:2345:x1868813737942400:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 29us (1462us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239923.235434:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 62 00000100:00080000:2.0:1782239923.235552:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782239923.235592:0:11534:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5c513c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:11534:1868813758949632:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1782239923.235628:0:11534:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782239923.235638:0:11534:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782239923.235640:0:11534:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1782239923.235645:0:11534:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1782239923.235881:0:5787:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1782239923.235903:0:5787:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1782239923.235915:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5ee29f800/0x8c5345f1c1ec4ef5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4efc expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239923.235934:0:5787:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff9bb5ee29f800/0x8c5345f1c1ec4ef5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4efc expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782239923.238371:0:11535:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1782239923.423802:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782239923.488720:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5ee2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1868813758949760:0@lo:400:kworker.0 00000100:00100000:3.0:1782239923.488741:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5ee2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1868813758949888:0@lo:400:kworker.0 00000100:00100000:2.0:1782239923.488895:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5ee2fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1868813758950144:0@lo:400:kworker.0 00000100:00100000:0.0:1782239923.489007:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5ee2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813758950016:0@lo:400:kworker.0 00000100:00100000:3.0:1782239923.490555:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239923.497505:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758949888 00000100:00100000:3.0:1782239923.497526:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758949888 00000100:00100000:1.0:1782239923.501731:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1782239923.501870:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782239923.504844:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5ee2ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1868813758950272:0@lo:400:kworker.0 00000100:00100000:1.0:1782239923.504923:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239923.505798:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758949760 00000100:00100000:3.0:1782239923.505818:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758949760 00000100:00100000:3.0:1782239923.505944:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1782239923.506023:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ee2fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1868813758949888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782239923.506147:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ee2fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1868813758949888:12345-0@lo:400:kworker.0 Request processed in 193us (15600us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239923.506155:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1782239923.506177:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1782239923.506184:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fff03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1868813758949760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782239923.506228:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fff03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1868813758949760:12345-0@lo:400:kworker.0 Request processed in 45us (4508us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239923.506235:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1782239923.506327:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5ee2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1868813758949888:0@lo:400:kworker.0 00000100:00100000:2.0:1782239923.506386:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239923.506491:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758950144 00000100:00100000:2.0:1782239923.506499:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758950144 00000100:00100000:2.0:1782239923.506561:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1782239923.506571:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5c513c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1868813758950144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782239923.506709:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5c513c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1868813758950144:12345-0@lo:400:kworker.0 Request processed in 139us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239923.506717:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00080000:2.0:1782239923.506740:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782239923.506901:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5ee2fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1868813758950144:0@lo:400:kworker.0 00000100:00100000:2.0:1782239923.506956:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758950272 00000100:00100000:2.0:1782239923.506960:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758950272 00000100:00100000:2.0:1782239923.506996:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1782239923.507003:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fff01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1868813758950272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782239923.507040:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fff01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1868813758950272:12345-0@lo:400:kworker.0 Request processed in 38us (2118us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239923.507047:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:2.0:1782239923.507064:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782239923.507422:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5ee2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1868813758949760:0@lo:400:kworker.0 00010000:00080000:1.0:1782239923.507439:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb5ee2ff480 x1868813758950272/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782239939 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782239923.507450:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5ee2ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1868813758950272:0@lo:400:kworker.0 00000100:00100000:0.0:1782239923.512542:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239923.513458:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758950016 00000100:00100000:1.0:1782239923.513472:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758950016 00000100:00100000:1.0:1782239923.513542:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1782239923.513553:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8eca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1868813758950016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782239923.513726:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8eca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1868813758950016:12345-0@lo:400:kworker.0 Request processed in 174us (1195us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239923.513733:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1782239923.513876:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5ee2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813758950016:0@lo:400:kworker.0 00000100:00100000:0.0:1782239924.000830:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782239924.000853:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5e8ec9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813758950400:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782239924.001679:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239924.001872:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758950400 00000100:00100000:2.0:1782239924.001883:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758950400 00000100:00100000:2.0:1782239924.001947:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1782239924.001956:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8ecbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1868813758950400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782239924.002029:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782239924.002078:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8ecbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1868813758950400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239924.002085:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:0.0:1782239924.002331:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb5e8ec9500 x1868813758950400/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782239940 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782239924.002353:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5e8ec9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813758950400:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1782239924.255511:0:11535:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1782239924.448259:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782239925.471061:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782239926.502004:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782239927.521104:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782239927.583127:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5c513c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813758950528:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782239927.583197:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239927.583335:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758950528 00000100:00100000:0.0:1782239927.583343:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758950528 00000100:00100000:0.0:1782239927.583401:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1782239927.583411:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5c513ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1868813758950528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782239927.583447:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782239927.583487:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5c513ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1868813758950528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239927.583494:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:2.0:1782239927.583666:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782239927.583698:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5c513c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813758950528:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782239928.340552:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239928.340611:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239928.340678:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239928.340728:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239928.340992:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737942912 00000100:00100000:0.0:1782239928.341002:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737942912 00000100:00100000:0.0:1782239928.341101:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 65 00000100:00100000:0.0:1782239928.341113:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fff02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+5:2344:x1868813737942912:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:0.0:1782239928.341185:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fff02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+5:2344:x1868813737942912:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 75us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239928.341193:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 65 00000100:00100000:2.0:1782239928.341436:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737942656 00000100:00100000:2.0:1782239928.341442:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737942656 00000100:00100000:2.0:1782239928.341490:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 278 00000100:00100000:2.0:1782239928.341498:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8d76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afaefb1a-536b-42a3-a3ff-47200f8611c3+13:2344:x1868813737942656:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:2.0:1782239928.341530:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8d76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afaefb1a-536b-42a3-a3ff-47200f8611c3+13:2344:x1868813737942656:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 33us (986us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239928.341549:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 278 00000100:00100000:2.0:1782239928.341581:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737942784 00000100:00100000:2.0:1782239928.341585:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737942784 00000100:00100000:2.0:1782239928.341614:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737943040 00000100:00100000:2.0:1782239928.341617:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737943040 00000100:00100000:2.0:1782239928.341638:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 117 00000100:00100000:2.0:1782239928.341645:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ffd6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+5:2344:x1868813737942784:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:2.0:1782239928.341677:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ffd6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+5:2344:x1868813737942784:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 32us (998us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239928.341684:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 117 00000100:00100000:2.0:1782239928.341697:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 118 00000100:00100000:2.0:1782239928.341705:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ffd6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f135cc01-3d42-4f2a-80ff-79724f1d3285+5:2344:x1868813737943040:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:2.0:1782239928.341782:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ffd6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f135cc01-3d42-4f2a-80ff-79724f1d3285+5:2344:x1868813737943040:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 78us (1053us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239928.341789:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 118 00000100:00080000:1.0:1782239928.342350:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782239928.342356:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1782239928.543081:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782239928.607174:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5ffd6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813758951040:0@lo:400:kworker.0 00000100:00100000:2.0:1782239928.607256:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239928.607331:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782239928.607338:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5ffd6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1868813758950912:0@lo:400:kworker.0 00000100:00100000:2.0:1782239928.607364:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239928.607397:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5ffd6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3306:1868813758950656:0@lo:400:kworker.0 00000100:00100000:2.0:1782239928.607423:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239928.607443:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5ffd6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1868813758951168:0@lo:400:kworker.0 00000100:00100000:2.0:1782239928.607461:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239928.607490:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1782239928.607495:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5ffd6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1868813758950784:0@lo:400:kworker.0 00000100:00100000:2.0:1782239928.607513:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239928.607578:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5ffd6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813758951296:0@lo:400:kworker.0 00000100:00100000:2.0:1782239928.607597:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239928.607622:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758950656 00000100:00100000:2.0:1782239928.607628:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758950656 00000100:00100000:2.0:1782239928.607677:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1782239928.607685:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8d77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:3306:x1868813758950656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782239928.607728:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8d77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:3306:x1868813758950656:12345-0@lo:400:kworker.0 Request processed in 44us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239928.607735:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1782239928.607794:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758951040 00000100:00100000:2.0:1782239928.607798:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758951040 00000100:00100000:2.0:1782239928.607823:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758951296 00000100:00100000:2.0:1782239928.607826:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758951296 00000100:00100000:2.0:1782239928.607932:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1782239928.607938:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5c513c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1868813758951040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782239928.607973:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5c513c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1868813758951040:12345-0@lo:400:kworker.0 Request processed in 35us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239928.607979:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1782239928.607989:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1782239928.607995:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5c513ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1868813758951296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782239928.608019:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5c513ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1868813758951296:12345-0@lo:400:kworker.0 Request processed in 25us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239928.608024:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1782239928.608040:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758950912 00000100:00100000:2.0:1782239928.608050:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758950912 00000100:00100000:2.0:1782239928.608076:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758951168 00000100:00100000:2.0:1782239928.608079:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758951168 00000100:00100000:2.0:1782239928.608092:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758950784 00000100:00100000:2.0:1782239928.608095:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758950784 00000100:00100000:2.0:1782239928.608105:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1782239928.608111:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5c513f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1868813758950912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782239928.608142:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5c513f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1868813758950912:12345-0@lo:400:kworker.0 Request processed in 32us (777us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239928.608148:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1782239928.608159:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1782239928.608165:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5c513f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1868813758951168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782239928.608189:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5c513f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1868813758951168:12345-0@lo:400:kworker.0 Request processed in 26us (728us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239928.608194:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1782239928.608204:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1782239928.608210:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5c513e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1868813758950784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782239928.608235:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5c513e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1868813758950784:12345-0@lo:400:kworker.0 Request processed in 26us (721us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239928.608240:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:2.0:1782239928.608255:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782239928.608259:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782239928.608309:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5ffd6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1868813758950912:0@lo:400:kworker.0 00000100:00100000:2.0:1782239928.608321:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5ffd6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813758951040:0@lo:400:kworker.0 00000100:00100000:2.0:1782239928.608346:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5ffd6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1868813758950784:0@lo:400:kworker.0 00010000:00080000:2.0:1782239928.608358:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb5ffd6c000 x1868813758951296/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782239944 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782239928.608374:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5ffd6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813758951296:0@lo:400:kworker.0 00000100:00100000:2.0:1782239928.608383:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5ffd6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3306:1868813758950656:0@lo:400:kworker.0 00000100:00100000:2.0:1782239928.608393:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5ffd6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1868813758951168:0@lo:400:kworker.0 00000100:00100000:2.0:1782239929.118992:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782239929.119016:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5e8ec9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813758951424:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782239929.119088:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239929.119332:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758951424 00000100:00100000:0.0:1782239929.119342:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758951424 00000100:00100000:0.0:1782239929.119397:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1782239929.119406:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5c513d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1868813758951424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782239929.119458:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782239929.119516:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5c513d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1868813758951424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239929.119523:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:1.0:1782239929.119680:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb5e8ec9500 x1868813758951424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782239945 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782239929.119721:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5e8ec9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813758951424:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782239929.567213:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782239930.591120:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782239931.636522:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782239932.643702:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782239932.703560:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fbf25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813758951552:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782239932.704124:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239932.704347:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758951552 00000100:00100000:3.0:1782239932.704357:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758951552 00000100:00100000:3.0:1782239932.704437:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1782239932.704448:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ffd6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1868813758951552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782239932.704483:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782239932.704541:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ffd6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1868813758951552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239932.704548:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:2.0:1782239932.704801:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782239932.704876:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fbf25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813758951552:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782239933.459821:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239933.459862:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239933.460075:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239933.460144:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239933.460186:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737943424 00000100:00100000:3.0:1782239933.460195:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737943424 00000100:00100000:3.0:1782239933.460261:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 68 00000100:00100000:3.0:1782239933.460274:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ee2fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+5:2347:x1868813737943424:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:3.0:1782239933.460339:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ee2fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+5:2347:x1868813737943424:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 70us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239933.460347:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 68 00000100:00080000:3.0:1782239933.460373:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782239933.460514:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737943168 00000100:00100000:1.0:1782239933.460519:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737943168 00000100:00100000:1.0:1782239933.460556:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 280 00000100:00100000:1.0:1782239933.460563:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d1bad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afaefb1a-536b-42a3-a3ff-47200f8611c3+13:2347:x1868813737943168:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:1.0:1782239933.460592:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d1bad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afaefb1a-536b-42a3-a3ff-47200f8611c3+13:2347:x1868813737943168:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 29us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239933.460598:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 280 00000100:00100000:0.0:1782239933.461207:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737943296 00000100:00100000:0.0:1782239933.461213:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737943296 00000100:00100000:0.0:1782239933.461276:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737943552 00000100:00100000:0.0:1782239933.461280:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737943552 00000100:00100000:0.0:1782239933.461307:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 122 00000100:00100000:0.0:1782239933.461313:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ee2fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+5:2347:x1868813737943296:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:0.0:1782239933.461352:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ee2fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+5:2347:x1868813737943296:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 39us (1542us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239933.461359:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 122 00000100:00100000:0.0:1782239933.461372:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 123 00000100:00100000:0.0:1782239933.461378:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ee2fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f135cc01-3d42-4f2a-80ff-79724f1d3285+5:2347:x1868813737943552:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:0.0:1782239933.461401:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ee2fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f135cc01-3d42-4f2a-80ff-79724f1d3285+5:2347:x1868813737943552:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 24us (1539us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239933.461407:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 123 00000100:00080000:3.0:1782239933.461470:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1782239933.662981:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782239933.727860:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5ffd6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813758952064:0@lo:400:kworker.0 00000100:00100000:0.0:1782239933.728056:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5ffd6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1868813758951936:0@lo:400:kworker.0 00000100:00100000:0.0:1782239933.728102:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239933.728193:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758951936 00000100:00100000:0.0:1782239933.728200:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758951936 00000100:00100000:0.0:1782239933.728303:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1782239933.728317:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8ec9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1868813758951936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782239933.728413:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8ec9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1868813758951936:12345-0@lo:400:kworker.0 Request processed in 99us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239933.728420:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:0.0:1782239933.728449:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782239933.728487:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5ffd6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1868813758951936:0@lo:400:kworker.0 00000100:00100000:3.0:1782239933.728847:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5ffd6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1868813758951808:0@lo:400:kworker.0 00000100:00100000:3.0:1782239933.728907:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239933.728942:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5ffd6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1868813758952320:0@lo:400:kworker.0 00000100:00100000:0.0:1782239933.729068:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758951808 00000100:00100000:0.0:1782239933.729073:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758951808 00000100:00100000:0.0:1782239933.729127:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1782239933.729136:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ee2fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1868813758951808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782239933.729180:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ee2fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1868813758951808:12345-0@lo:400:kworker.0 Request processed in 45us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239933.729188:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1782239933.729367:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5ffd6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3306:1868813758951680:0@lo:400:kworker.0 00000100:00100000:2.0:1782239933.729402:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239933.729437:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5ffd6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1868813758952192:0@lo:400:kworker.0 00000100:00100000:2.0:1782239933.729458:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239933.729527:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758951680 00000100:00100000:3.0:1782239933.729531:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758951680 00000100:00100000:3.0:1782239933.729569:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:3.0:1782239933.729576:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d1bae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:3306:x1868813758951680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782239933.729620:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d1bae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:3306:x1868813758951680:12345-0@lo:400:kworker.0 Request processed in 43us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239933.729626:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1782239933.729800:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5ffd6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3306:1868813758951680:0@lo:400:kworker.0 00000100:00100000:1.0:1782239933.729889:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239933.729975:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239933.730021:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5ffd6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1868813758951808:0@lo:400:kworker.0 00000100:00100000:0.0:1782239933.730204:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758952192 00000100:00100000:0.0:1782239933.730209:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758952192 00000100:00100000:0.0:1782239933.730268:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1782239933.730275:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fbf25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1868813758952192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782239933.730318:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fbf25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1868813758952192:12345-0@lo:400:kworker.0 Request processed in 43us (858us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239933.730324:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1782239933.730394:0:8312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758952064 00000100:00100000:2.0:1782239933.730398:0:8312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758952064 00000100:00100000:2.0:1782239933.730433:0:8312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758952320 00000100:00100000:2.0:1782239933.730436:0:8312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758952320 00000100:00100000:2.0:1782239933.730458:0:8312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1782239933.730464:0:8312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ffd6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1868813758952064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782239933.730504:0:8312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ffd6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1868813758952064:12345-0@lo:400:kworker.0 Request processed in 40us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239933.730511:0:8312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1782239933.730523:0:8312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1782239933.730529:0:8312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ee2ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1868813758952320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782239933.730577:0:8312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ee2ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1868813758952320:12345-0@lo:400:kworker.0 Request processed in 49us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239933.730583:0:8312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1782239933.730627:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5ffd6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1868813758952192:0@lo:400:kworker.0 00010000:00080000:2.0:1782239933.730654:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb5ffd6c380 x1868813758952320/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782239949 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782239933.730666:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5ffd6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1868813758952320:0@lo:400:kworker.0 00000100:00100000:2.0:1782239933.730688:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5ffd6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813758952064:0@lo:400:kworker.0 00000100:00080000:3.0:1782239933.730814:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782239933.730819:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782239934.239296:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782239934.239323:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5e8ec8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813758952448:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782239934.239399:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239934.239560:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758952448 00000100:00100000:0.0:1782239934.239568:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758952448 00000100:00100000:0.0:1782239934.239621:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1782239934.239631:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb6018cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1868813758952448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782239934.239666:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782239934.239722:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb6018cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1868813758952448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239934.239744:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:1.0:1782239934.239847:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb5e8ec8380 x1868813758952448/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782239950 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782239934.239868:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5e8ec8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813758952448:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1782239934.497487:0:11535:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1782239934.688470:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782239935.711310:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782239936.734993:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782239937.759769:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782239937.823389:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb6018cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813758952576:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782239937.823458:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239937.823594:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758952576 00000100:00100000:3.0:1782239937.823602:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758952576 00000100:00100000:3.0:1782239937.823665:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1782239937.823675:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ffd6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1868813758952576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782239937.823720:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782239937.823800:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ffd6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1868813758952576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 127us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239937.823807:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:1.0:1782239937.823951:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782239937.823998:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb6018cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813758952576:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782239938.581907:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239938.581991:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239938.585046:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737943680 00000100:00100000:2.0:1782239938.585066:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737943680 00000100:00100000:2.0:1782239938.585182:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 282 00000100:00100000:2.0:1782239938.585192:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d1bac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afaefb1a-536b-42a3-a3ff-47200f8611c3+13:2344:x1868813737943680:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:2.0:1782239938.585295:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d1bac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afaefb1a-536b-42a3-a3ff-47200f8611c3+13:2344:x1868813737943680:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 101us (3393us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239938.585305:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 282 00000100:00100000:0.0:1782239938.585402:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737943808 00000100:00100000:0.0:1782239938.585409:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737943808 00000100:00100000:0.0:1782239938.585461:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 127 00000100:00100000:0.0:1782239938.585471:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ee2fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+5:2344:x1868813737943808:12345-192.168.203.32@tcp:400:kworker.0 00000100:00080000:3.0:1782239938.585499:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782239938.585501:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ee2fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+5:2344:x1868813737943808:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 34us (3510us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239938.585508:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 127 00000100:00100000:1.0:1782239938.606682:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239938.606731:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239938.606840:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737944064 00000100:00100000:0.0:1782239938.606851:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737944064 00000100:00100000:0.0:1782239938.606922:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 128 00000100:00100000:0.0:1782239938.606932:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ffd6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f135cc01-3d42-4f2a-80ff-79724f1d3285+5:2345:x1868813737944064:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:0.0:1782239938.607011:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ffd6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f135cc01-3d42-4f2a-80ff-79724f1d3285+5:2345:x1868813737944064:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 80us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239938.607020:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 128 00000100:00080000:3.0:1782239938.607246:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782239938.607502:0:8312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737943936 00000100:00100000:2.0:1782239938.607508:0:8312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737943936 00000100:00100000:2.0:1782239938.607570:0:8312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 19 00000100:00100000:2.0:1782239938.607580:0:8312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ffd6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+5:2343:x1868813737943936:12345-192.168.203.32@tcp:9:kworker.0 00000020:00000080:2.0:1782239938.607601:0:8312:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8c5345f1c1ec4e38 00000100:00080000:2.0:1782239938.607609:0:8312:0:(import.c:65:import_set_state_nolock()) ffff9bb5d8199000 : changing import state from FULL to CLOSED 00000100:00080000:3.0:1782239938.607807:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00000004:2.0:1782239938.607890:0:8312:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:2.0:1782239938.608154:0:8312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ffd6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+2:2343:x1868813737943936:12345-192.168.203.32@tcp:9:kworker.0 Request processed in 576us (1420us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239938.608163:0:8312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 19 00010000:00010000:1.0:1782239938.618142:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782239938.782966:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782239938.846991:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5ffd6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1868813758952832:0@lo:400:kworker.0 00000100:00100000:1.0:1782239938.846992:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5ffd6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813758953088:0@lo:400:kworker.0 00000100:00100000:0.0:1782239938.847088:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5ffd6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1868813758952960:0@lo:400:kworker.0 00000100:00100000:2.0:1782239938.847275:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5ffd6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3306:1868813758952704:0@lo:400:kworker.0 00000100:00100000:3.0:1782239938.852271:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239938.852271:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239938.852364:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5ffd6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1868813758953344:0@lo:400:kworker.0 00000100:00100000:1.0:1782239938.852394:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758953088 00000100:00100000:1.0:1782239938.852405:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758953088 00000100:00100000:3.0:1782239938.852414:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239938.852460:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758953344 00000100:00100000:1.0:1782239938.852465:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758953344 00000100:00100000:3.0:1782239938.852488:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1782239938.852503:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ffd6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1868813758953088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782239938.852558:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ffd6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1868813758953088:12345-0@lo:400:kworker.0 Request processed in 60us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239938.852565:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1782239938.852601:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758952832 00000100:00100000:3.0:1782239938.852605:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758952832 00000100:00100000:3.0:1782239938.852638:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1782239938.852645:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ee2fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1868813758952832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782239938.852682:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ee2fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1868813758952832:12345-0@lo:400:kworker.0 Request processed in 38us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239938.852703:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1782239938.852743:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5ffd6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1868813758952832:0@lo:400:kworker.0 00000100:00100000:1.0:1782239938.853793:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1782239938.853804:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ee2fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1868813758953344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782239938.853861:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ee2fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1868813758953344:12345-0@lo:400:kworker.0 Request processed in 60us (1448us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239938.853867:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1782239938.853903:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5ffd6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813758953088:0@lo:400:kworker.0 00010000:00080000:1.0:1782239938.853935:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb5ffd6f800 x1868813758953344/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782239954 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782239938.853946:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5ffd6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1868813758953344:0@lo:400:kworker.0 00000100:00080000:3.0:1782239938.853952:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782239938.854825:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239938.854944:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758952960 00000100:00100000:1.0:1782239938.854952:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758952960 00000100:00100000:1.0:1782239938.855011:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1782239938.855019:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8ec8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1868813758952960:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1782239938.855061:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782239938.855072:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8ec8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1868813758952960:12345-0@lo:400:kworker.0 Request processed in 53us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239938.855095:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1782239938.855224:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5ffd6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1868813758952960:0@lo:400:kworker.0 00000100:00100000:2.0:1782239938.855269:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239938.855311:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5ffd6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1868813758953216:0@lo:400:kworker.0 00000100:00100000:2.0:1782239938.855342:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239938.855445:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758952704 00000100:00100000:3.0:1782239938.855450:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758952704 00000100:00100000:3.0:1782239938.855535:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1782239938.855544:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d1baec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:3306:x1868813758952704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782239938.855595:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d1baec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:3306:x1868813758952704:12345-0@lo:400:kworker.0 Request processed in 53us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239938.855601:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1782239938.855668:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758953216 00000100:00100000:0.0:1782239938.855672:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758953216 00000100:00100000:0.0:1782239938.855707:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1782239938.855714:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb6018cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1868813758953216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782239938.855770:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb6018cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1868813758953216:12345-0@lo:400:kworker.0 Request processed in 35us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239938.855783:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:0.0:1782239938.855815:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782239938.856461:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5ffd6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3306:1868813758952704:0@lo:400:kworker.0 00000100:00100000:1.0:1782239938.856476:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5ffd6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1868813758953216:0@lo:400:kworker.0 00000100:00100000:1.0:1782239939.362298:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782239939.362327:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb6018ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813758953472:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782239939.362403:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239939.362517:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758953472 00000100:00100000:3.0:1782239939.362527:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758953472 00000100:00100000:3.0:1782239939.362606:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1782239939.362617:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ffd6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1868813758953472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782239939.362655:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782239939.362710:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ffd6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1868813758953472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239939.362717:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:1.0:1782239939.362809:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb6018ced80 x1868813758953472/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782239955 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782239939.362828:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb6018ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813758953472:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782239939.816187:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782239940.832107:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1782239940.980234:0:6614:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 36dd742b-25b8-431e-bf41-75f2fff47ffb 00000020:00000080:0.0:1782239940.980242:0:6614:0:(genops.c:906:class_export_put()) final put ffff9bb60166f000/36dd742b-25b8-431e-bf41-75f2fff47ffb 00000020:00000080:3.0:1782239940.980315:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9bb60166f000/36dd742b-25b8-431e-bf41-75f2fff47ffb for lustre-OST0000 00000020:00000080:3.0:1782239940.980375:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9bb5d8199000 for lustre-OST0000 00010000:00010000:0.0:1782239941.856682:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782239942.880482:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782239942.945575:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb6018cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813758953600:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782239942.945662:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239942.945788:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758953600 00000100:00100000:2.0:1782239942.945809:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758953600 00000100:00100000:2.0:1782239942.945876:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1782239942.945888:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ee2ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1868813758953600:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1782239942.946042:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1782239942.946095:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782239942.946154:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ee2ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1868813758953600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 269us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239942.946162:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1782239942.946253:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb6018cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813758953600:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782239943.707063:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239943.707105:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239943.707130:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239943.707176:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737944448 00000100:00100000:3.0:1782239943.707186:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737944448 00000100:00100000:3.0:1782239943.707240:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737944320 00000100:00100000:3.0:1782239943.707244:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737944320 00000100:00100000:2.0:1782239943.707262:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737944192 00000100:00100000:3.0:1782239943.707265:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 132 00000100:00100000:2.0:1782239943.707266:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737944192 00000100:00100000:3.0:1782239943.707275:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ee2fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f135cc01-3d42-4f2a-80ff-79724f1d3285+5:2346:x1868813737944448:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:2.0:1782239943.707295:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 284 00000100:00100000:2.0:1782239943.707301:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d1bad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afaefb1a-536b-42a3-a3ff-47200f8611c3+13:2346:x1868813737944192:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:3.0:1782239943.707348:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ee2fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f135cc01-3d42-4f2a-80ff-79724f1d3285+5:2346:x1868813737944448:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 74us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239943.707357:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 132 00000100:00100000:3.0:1782239943.707379:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 133 00000100:00100000:3.0:1782239943.707387:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ee2ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+5:2346:x1868813737944320:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:2.0:1782239943.707815:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d1bad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afaefb1a-536b-42a3-a3ff-47200f8611c3+13:2346:x1868813737944192:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 511us (758us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239943.707823:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 284 00000100:00080000:2.0:1782239943.707871:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782239943.710415:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ee2ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+5:2346:x1868813737944320:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 3018us (3272us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239943.710450:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 133 00010000:00010000:1.0:1782239943.903102:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782239943.967324:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f779f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813758954112:0@lo:400:kworker.0 00000100:00100000:3.0:1782239943.967399:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239943.967409:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f779f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3306:1868813758953728:0@lo:400:kworker.0 00000100:00100000:2.0:1782239943.967452:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239943.967459:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782239943.967468:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f779dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1868813758953984:0@lo:400:kworker.0 00000100:00100000:2.0:1782239943.967485:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f779c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1868813758954240:0@lo:400:kworker.0 00000100:00100000:3.0:1782239943.967500:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239943.967519:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239943.967545:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1782239943.967550:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758954112 00000100:00100000:2.0:1782239943.967551:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f779e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1868813758953856:0@lo:400:kworker.0 00000100:00100000:3.0:1782239943.967560:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758954112 00000100:00100000:2.0:1782239943.967577:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239943.967598:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f779d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813758954368:0@lo:400:kworker.0 00000100:00100000:3.0:1782239943.967618:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1782239943.967624:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239943.967632:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f779ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1868813758954112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782239943.967655:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758953728 00000100:00100000:2.0:1782239943.967660:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758953728 00000100:00100000:3.0:1782239943.967692:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f779ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1868813758954112:12345-0@lo:400:kworker.0 Request processed in 62us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239943.967696:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1782239943.967708:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1782239943.967709:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d1bad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:3306:x1868813758953728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782239943.967735:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758954368 00000100:00100000:3.0:1782239943.967739:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758954368 00000100:00100000:2.0:1782239943.967774:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d1bad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:3306:x1868813758953728:12345-0@lo:400:kworker.0 Request processed in 69us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239943.967782:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1782239943.967800:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1782239943.967809:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb6018ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1868813758954368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782239943.967815:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758953984 00000100:00100000:2.0:1782239943.967819:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758953984 00000100:00100000:3.0:1782239943.967847:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb6018ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1868813758954368:12345-0@lo:400:kworker.0 Request processed in 38us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239943.967848:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758954240 00000100:00100000:2.0:1782239943.967853:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758954240 00000100:00100000:3.0:1782239943.967858:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1782239943.967869:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758953856 00000100:00100000:2.0:1782239943.967872:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758953856 00000100:00100000:2.0:1782239943.967890:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1782239943.967897:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f779df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1868813758953984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782239943.967908:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f779f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813758954112:0@lo:400:kworker.0 00000100:00100000:3.0:1782239943.967937:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f779dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1868813758953984:0@lo:400:kworker.0 00000100:00100000:2.0:1782239943.967937:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f779df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1868813758953984:12345-0@lo:400:kworker.0 Request processed in 39us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239943.967951:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1782239943.967965:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1782239943.967975:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb6018ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1868813758954240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782239943.968005:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb6018ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1868813758954240:12345-0@lo:400:kworker.0 Request processed in 35us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239943.968011:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1782239943.968024:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1782239943.968035:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb6018cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1868813758953856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782239943.968072:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb6018cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1868813758953856:12345-0@lo:400:kworker.0 Request processed in 39us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239943.969783:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f779e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1868813758953856:0@lo:400:kworker.0 00010000:00080000:1.0:1782239943.969803:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb5f779d180 x1868813758954368/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782239959 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782239943.969815:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f779d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813758954368:0@lo:400:kworker.0 00000100:00100000:1.0:1782239943.969826:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f779f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3306:1868813758953728:0@lo:400:kworker.0 00000100:00100000:1.0:1782239943.969837:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f779c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1868813758954240:0@lo:400:kworker.0 00000100:00080000:1.0:1782239943.969874:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782239943.969880:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782239943.981478:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1782239944.479151:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5ffd6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1868813758954496:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782239944.479637:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239944.480177:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758954496 00000100:00100000:3.0:1782239944.480187:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758954496 00000100:00100000:3.0:1782239944.480328:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1782239944.480339:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ffd6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1868813758954496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782239944.480377:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782239944.480482:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ffd6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1868813758954496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 145us (1246us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239944.480490:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:1.0:1782239944.480557:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb5ffd6c380 x1868813758954496/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782239960 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782239944.480577:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5ffd6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1868813758954496:0@lo:13:osp-pre-1-0.0 00000040:00080000:2.0:1782239944.738688:0:11535:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1782239944.930216:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1782239945.719554:0:11699:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 14:39:04 (1782239944) 00010000:00010000:1.0:1782239945.958387:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782239946.975619:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782239947.703488:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239947.705942:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737944576 00000100:00100000:1.0:1782239947.706036:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737944576 00000100:00100000:1.0:1782239947.706376:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 32 00000100:00100000:1.0:1782239947.706395:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f779dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+5:10214:x1868813737944576:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782239947.706424:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782239947.706891:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38600/0x8c5345f1c1ec4f03 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e4ae expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239947.707338:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39c00/0x8c5345f1c1ec4f0a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239947.707365:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39c00/0x8c5345f1c1ec4f0a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239947.707379:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39c00/0x8c5345f1c1ec4f0a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782239947.707669:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1782239947.707673:0:5792:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000100:00080000:2.0:1782239947.707699:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00010000:1.0:1782239947.707820:0:5792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39c00/0x8c5345f1c1ec4f0a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239947.707852:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38600/0x8c5345f1c1ec4f03 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e4ae expref: 7 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239947.707886:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39c00/0x8c5345f1c1ec4f0a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e4ae expref: 6 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239947.707894:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bb5c30e4200) 00010000:00010000:1.0:1782239947.707897:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782239947.707901:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5f7e39c00, rc 0) 00000100:00100000:1.0:1782239947.707991:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f779dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+6:10214:x1868813737944576:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 1603us (4516us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239947.708000:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 32 00000100:00100000:0.0:1782239947.736270:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239947.736614:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737944704 00000100:00100000:2.0:1782239947.736628:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737944704 00000100:00100000:2.0:1782239947.736718:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 33 00000100:00100000:2.0:1782239947.736732:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8ec9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+6:10215:x1868813737944704:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782239947.736791:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782239947.736818:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e800/0x8c5345f1c1ec4f11 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e4b5 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239947.737036:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e000/0x8c5345f1c1ec4f18 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239947.737055:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e000/0x8c5345f1c1ec4f18 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239947.737068:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e000/0x8c5345f1c1ec4f18 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239947.737083:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e600/0x8c5345f1c1ec4f1f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239947.737091:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e600/0x8c5345f1c1ec4f1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239947.737127:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e600/0x8c5345f1c1ec4f1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239947.738351:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29f400/0x8c5345f1c1ec4f26 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239947.738382:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29f400/0x8c5345f1c1ec4f26 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239947.738393:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29f400/0x8c5345f1c1ec4f26 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782239947.738498:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1782239947.738512:0:5790:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1782239947.738606:0:5790:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29f400/0x8c5345f1c1ec4f26 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239947.738621:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e000/0x8c5345f1c1ec4f18 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239947.738628:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e000/0x8c5345f1c1ec4f18 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239947.738636:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e000/0x8c5345f1c1ec4f18 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239947.738642:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5ee29e000 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:2.0:1782239947.738647:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e000/0x8c5345f1c1ec4f18 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239947.738655:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e000/0x8c5345f1c1ec4f18 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239947.738679:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bb5c30e4200) 00010000:00010000:2.0:1782239947.738682:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782239947.738688:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e000/0x8c5345f1c1ec4f18 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239947.738695:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e000/0x8c5345f1c1ec4f18 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239947.738712:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e600/0x8c5345f1c1ec4f1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239947.738718:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e600/0x8c5345f1c1ec4f1f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239947.738724:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e600/0x8c5345f1c1ec4f1f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239947.738729:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5ee29e600 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:2.0:1782239947.738732:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e600/0x8c5345f1c1ec4f1f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239947.738737:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e600/0x8c5345f1c1ec4f1f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239947.738745:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9bb5c4ed6d00) 00010000:00010000:2.0:1782239947.738811:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782239947.738815:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e600/0x8c5345f1c1ec4f1f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239947.738820:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e600/0x8c5345f1c1ec4f1f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239947.739198:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e800/0x8c5345f1c1ec4f11 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e4b5 expref: 8 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239947.739215:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29f400/0x8c5345f1c1ec4f26 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e4b5 expref: 7 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239947.739223:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9bb5c4ed6000) 00010000:00010000:2.0:1782239947.739225:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782239947.739227:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5ee29f400, rc 0) 00000100:00100000:2.0:1782239947.739565:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8ec9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+7:10215:x1868813737944704:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 2833us (3310us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239947.739577:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 33 00000100:00100000:2.0:1782239947.743050:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239947.743239:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737944960 00000100:00100000:3.0:1782239947.743253:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737944960 00000100:00100000:3.0:1782239947.743620:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 34 00000100:00100000:3.0:1782239947.743634:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb6018cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+7:10215:x1868813737944960:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782239947.743664:0:6611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782239947.743691:0:6611:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44c00/0x8c5345f1c1ec4f2d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e4bc expref: -99 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239947.745188:0:6611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec4f34 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239947.745218:0:6611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec4f34 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239947.745234:0:6611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec4f34 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239947.745259:0:6611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44200/0x8c5345f1c1ec4f3b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239947.745267:0:6611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44200/0x8c5345f1c1ec4f3b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239947.745284:0:6611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44200/0x8c5345f1c1ec4f3b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239947.750124:0:6611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44e00/0x8c5345f1c1ec4f42 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239947.750168:0:6611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44e00/0x8c5345f1c1ec4f42 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239947.750183:0:6611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44e00/0x8c5345f1c1ec4f42 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782239947.750200:0:6611:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:3.0:1782239947.750596:0:6611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec4f34 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239947.750606:0:6611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec4f34 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239947.750622:0:6611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec4f34 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239947.750630:0:6611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5c2a44000 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:3.0:1782239947.750636:0:6611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec4f34 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239947.750645:0:6611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec4f34 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239947.750661:0:6611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9bb5c4ed6000) 00010000:00010000:3.0:1782239947.750665:0:6611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782239947.750672:0:6611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec4f34 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239947.750679:0:6611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec4f34 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239947.750697:0:6611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44200/0x8c5345f1c1ec4f3b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239947.750703:0:6611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44200/0x8c5345f1c1ec4f3b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239947.750709:0:6611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44200/0x8c5345f1c1ec4f3b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239947.750714:0:6611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5c2a44200 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:3.0:1782239947.750717:0:6611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44200/0x8c5345f1c1ec4f3b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239947.750734:0:6611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44200/0x8c5345f1c1ec4f3b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239947.750743:0:6611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9bb5d0df4c00) 00010000:00010000:3.0:1782239947.750745:0:6611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782239947.750791:0:6611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44200/0x8c5345f1c1ec4f3b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239947.750796:0:6611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44200/0x8c5345f1c1ec4f3b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239947.753175:0:6611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44c00/0x8c5345f1c1ec4f2d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e4bc expref: 10 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239947.753221:0:6611:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44e00/0x8c5345f1c1ec4f42 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e4bc expref: 9 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239947.753232:0:6611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bb5d0df4b00) 00010000:00010000:3.0:1782239947.753234:0:6611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782239947.753239:0:6611:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5c2a44e00, rc 0) 00000100:00100000:3.0:1782239947.753412:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb6018cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+9:10215:x1868813737944960:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 9772us (10368us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1782239947.753424:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 34 00000100:00100000:3.0:1782239947.766547:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239947.766805:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737945088 00000100:00100000:0.0:1782239947.766820:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737945088 00000100:00100000:1.0:1782239947.767177:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 35 00000100:00100000:1.0:1782239947.767191:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f779f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+9:10215:x1868813737945088:12345-192.168.203.32@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1782239947.767363:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f779f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+9:10215:x1868813737945088:12345-192.168.203.32@tcp:59:lhsmtool_posix.0 Request processed in 174us (841us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239947.767373:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 35 00000040:00080000:3.0:1782239947.810262:0:11535:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1782239948.003963:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782239948.067178:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5e8eed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813758954624:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782239948.067265:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239948.067442:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758954624 00000100:00100000:1.0:1782239948.067451:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758954624 00000100:00100000:1.0:1782239948.067522:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1782239948.067532:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8ec9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1868813758954624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782239948.067568:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782239948.067629:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8ec9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1868813758954624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239948.067637:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1782239948.067674:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5e8eed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813758954624:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1782239948.067741:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782239948.821845:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239948.821887:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239948.821912:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239948.821940:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737945472 00000100:00100000:0.0:1782239948.821949:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737945472 00000100:00100000:0.0:1782239948.822007:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737945344 00000100:00100000:0.0:1782239948.822011:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737945344 00000100:00100000:0.0:1782239948.822034:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 137 00000100:00100000:0.0:1782239948.822044:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8ec9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f135cc01-3d42-4f2a-80ff-79724f1d3285+5:2347:x1868813737945472:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:0.0:1782239948.822116:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8ec9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f135cc01-3d42-4f2a-80ff-79724f1d3285+5:2347:x1868813737945472:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 73us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239948.822142:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 137 00000100:00100000:0.0:1782239948.822162:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 138 00000100:00100000:0.0:1782239948.822168:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb60135aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+9:2347:x1868813737945344:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:0.0:1782239948.822199:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb60135aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+9:2347:x1868813737945344:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 30us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239948.822205:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 138 00000100:00080000:0.0:1782239948.822225:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782239948.824468:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737945216 00000100:00100000:3.0:1782239948.824482:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737945216 00000100:00100000:3.0:1782239948.824729:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 286 00000100:00100000:3.0:1782239948.824740:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d1baf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afaefb1a-536b-42a3-a3ff-47200f8611c3+13:2347:x1868813737945216:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:3.0:1782239948.824852:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d1baf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afaefb1a-536b-42a3-a3ff-47200f8611c3+13:2347:x1868813737945216:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 113us (3015us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239948.824860:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 286 00010000:00010000:3.0:1782239949.025624:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782239949.087113:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5ffd6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813758955136:0@lo:400:kworker.0 00000100:00100000:1.0:1782239949.087195:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239949.087267:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782239949.087275:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5ffd6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1868813758955008:0@lo:400:kworker.0 00000100:00100000:1.0:1782239949.087315:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239949.087349:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758955136 00000100:00100000:1.0:1782239949.087355:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758955136 00000100:00100000:1.0:1782239949.087407:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1782239949.087416:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ffd6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1868813758955136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782239949.087463:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ffd6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1868813758955136:12345-0@lo:400:kworker.0 Request processed in 48us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239949.087470:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1782239949.087499:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758955008 00000100:00100000:1.0:1782239949.087503:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758955008 00000100:00100000:1.0:1782239949.087536:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1782239949.087542:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ffd6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1868813758955008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782239949.087571:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ffd6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1868813758955008:12345-0@lo:400:kworker.0 Request processed in 30us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239949.087578:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00080000:1.0:1782239949.087595:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782239949.087628:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5ffd6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1868813758955008:0@lo:400:kworker.0 00000100:00100000:1.0:1782239949.087638:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5ffd6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813758955136:0@lo:400:kworker.0 00000100:00100000:2.0:1782239949.087800:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5ffd6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3306:1868813758954752:0@lo:400:kworker.0 00000100:00100000:2.0:1782239949.087837:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239949.087867:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5ffd6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1868813758955264:0@lo:400:kworker.0 00000100:00100000:2.0:1782239949.087891:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239949.087911:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1782239949.087917:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5ffd6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1868813758954880:0@lo:400:kworker.0 00000100:00100000:2.0:1782239949.087937:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239949.087954:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5ffd6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813758955392:0@lo:400:kworker.0 00000100:00100000:2.0:1782239949.087974:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239949.087999:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758955264 00000100:00100000:2.0:1782239949.088003:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758955264 00000100:00100000:2.0:1782239949.088055:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758954880 00000100:00100000:2.0:1782239949.088059:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758954880 00000100:00100000:2.0:1782239949.088074:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1782239949.088080:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8eedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1868813758955264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782239949.088118:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8eedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1868813758955264:12345-0@lo:400:kworker.0 Request processed in 38us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239949.088135:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1782239949.088148:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1782239949.088155:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8eedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1868813758954880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782239949.088180:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8eedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1868813758954880:12345-0@lo:400:kworker.0 Request processed in 27us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239949.088185:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1782239949.088204:0:8312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758955392 00000100:00100000:2.0:1782239949.088207:0:8312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758955392 00000100:00100000:2.0:1782239949.088229:0:8312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1782239949.088235:0:8312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8eed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1868813758955392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782239949.088263:0:8312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8eed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1868813758955392:12345-0@lo:400:kworker.0 Request processed in 28us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239949.088268:0:8312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1782239949.088292:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5ffd6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1868813758954880:0@lo:400:kworker.0 00010000:00080000:2.0:1782239949.088303:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb5ffd6e680 x1868813758955392/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782239965 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782239949.088313:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5ffd6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813758955392:0@lo:400:kworker.0 00000100:00100000:2.0:1782239949.088323:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5ffd6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1868813758955264:0@lo:400:kworker.0 00000100:00100000:1.0:1782239949.088721:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758954752 00000100:00100000:1.0:1782239949.088726:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758954752 00000100:00100000:1.0:1782239949.088788:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1782239949.088796:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d1badc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:3306:x1868813758954752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782239949.088851:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d1badc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:3306:x1868813758954752:12345-0@lo:400:kworker.0 Request processed in 55us (1012us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239949.088865:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00080000:1.0:1782239949.088896:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782239949.088900:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782239949.088998:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5ffd6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3306:1868813758954752:0@lo:400:kworker.0 00000100:00100000:1.0:1782239949.603331:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f779d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1868813758955520:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782239949.603401:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239949.603452:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758955520 00000100:00100000:3.0:1782239949.603461:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758955520 00000100:00100000:3.0:1782239949.603516:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1782239949.603525:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ffd6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1868813758955520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782239949.603561:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782239949.603606:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ffd6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1868813758955520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239949.603613:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:1.0:1782239949.603708:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb5f779d880 x1868813758955520/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782239965 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782239949.603727:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f779d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1868813758955520:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782239949.781428:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239949.781542:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737945600 00000100:00100000:3.0:1782239949.781552:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737945600 00000100:00100000:3.0:1782239949.781629:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 36 00000100:00080000:1.0:1782239949.781631:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782239949.781642:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ffd6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+9:10257:x1868813737945600:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:3.0:1782239949.781666:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782239949.781693:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44c00/0x8c5345f1c1ec4f50 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e4c3 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239949.781790:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44200/0x8c5345f1c1ec4f57 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239949.781806:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44200/0x8c5345f1c1ec4f57 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239949.781832:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44200/0x8c5345f1c1ec4f57 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239949.781846:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec4f5e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239949.781852:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec4f5e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239949.781859:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec4f5e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239949.782127:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44200/0x8c5345f1c1ec4f57 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239949.782136:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44200/0x8c5345f1c1ec4f57 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239949.782142:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44200/0x8c5345f1c1ec4f57 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239949.782148:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5c2a44200 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:3.0:1782239949.782152:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44200/0x8c5345f1c1ec4f57 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239949.782159:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44200/0x8c5345f1c1ec4f57 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239949.782173:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bb5c30e4200) 00010000:00010000:3.0:1782239949.782176:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782239949.782181:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44200/0x8c5345f1c1ec4f57 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239949.782192:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44200/0x8c5345f1c1ec4f57 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239949.782204:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec4f5e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239949.782210:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec4f5e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239949.782216:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec4f5e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239949.782221:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5c2a44000 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:3.0:1782239949.782224:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec4f5e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239949.782230:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec4f5e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239949.782238:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9bb5d0df4c00) 00010000:00010000:3.0:1782239949.782240:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782239949.782243:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec4f5e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239949.782248:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec4f5e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239949.782277:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44c00/0x8c5345f1c1ec4f50 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e4c3 expref: 10 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239949.782295:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bb5c30e4200) 00010000:00010000:3.0:1782239949.782297:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782239949.782300:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44c00/0x8c5345f1c1ec4f50 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e4c3 expref: 10 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239949.782308:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5c2a44c00, rc 0) 00000100:00100000:3.0:1782239949.782370:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ffd6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+9:10257:x1868813737945600:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 730us (953us total) trans 0 rc 301/301 00000100:00100000:3.0:1782239949.782377:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 36 00000100:00100000:1.0:1782239949.785594:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239949.785667:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737945856 00000100:00100000:3.0:1782239949.785679:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737945856 00000100:00100000:3.0:1782239949.785767:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 37 00000100:00100000:3.0:1782239949.785781:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ffd6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+9:10257:x1868813737945856:12345-192.168.203.32@tcp:36:lfs.0 00010000:00010000:3.0:1782239949.785842:0:6611:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782239949.785868:0:6611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39c00/0x8c5345f1c1ec4f0a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e4ae expref: 9 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239949.785888:0:6611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bb5c30e4200) 00010000:00010000:3.0:1782239949.785899:0:6611:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782239949.786181:0:6611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044a00/0x8c5345f1c1ec4f65 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239949.786197:0:6611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044a00/0x8c5345f1c1ec4f65 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239949.786207:0:6611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044a00/0x8c5345f1c1ec4f65 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239949.786230:0:6611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044e00/0x8c5345f1c1ec4f6c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239949.786237:0:6611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044e00/0x8c5345f1c1ec4f6c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239949.786243:0:6611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044e00/0x8c5345f1c1ec4f6c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782239949.787261:0:6611:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1782239949.787276:0:6611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044a00/0x8c5345f1c1ec4f65 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239949.787286:0:6611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044a00/0x8c5345f1c1ec4f65 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239949.787293:0:6611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044a00/0x8c5345f1c1ec4f65 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239949.787300:0:6611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb602044a00 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:3.0:1782239949.787304:0:6611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044a00/0x8c5345f1c1ec4f65 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239949.787312:0:6611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044a00/0x8c5345f1c1ec4f65 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239949.787327:0:6611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bb5d0df4400) 00010000:00010000:3.0:1782239949.787330:0:6611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782239949.787334:0:6611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044a00/0x8c5345f1c1ec4f65 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239949.787350:0:6611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044a00/0x8c5345f1c1ec4f65 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782239949.787369:0:6611:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005451d3a7 reply state 00000000464e0e62 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044e00/0x8c5345f1c1ec4f6c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239949.787378:0:6611:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782239949.787498:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ffd6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+10:10257:x1868813737945856:12345-192.168.203.32@tcp:36:lfs.0 Request processed in 1717us (1910us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1782239949.787506:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 37 00010000:00010000:0.0:1782239949.792886:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044e00/0x8c5345f1c1ec4f6c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239949.792905:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044e00/0x8c5345f1c1ec4f6c lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239949.792913:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044e00/0x8c5345f1c1ec4f6c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239949.792919:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb602044e00 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:0.0:1782239949.792923:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044e00/0x8c5345f1c1ec4f6c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239949.792931:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044e00/0x8c5345f1c1ec4f6c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239949.792947:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9bb5d0df4a00) 00010000:00010000:0.0:1782239949.792950:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782239949.792954:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044e00/0x8c5345f1c1ec4f6c lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239949.792960:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044e00/0x8c5345f1c1ec4f6c lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239949.910731:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239949.910999:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737945984 00000100:00100000:3.0:1782239949.911010:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737945984 00000100:00100000:3.0:1782239949.911142:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 38 00000100:00100000:3.0:1782239949.911152:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ffd6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+9:10265:x1868813737945984:12345-192.168.203.32@tcp:101:lctl.0 00010000:00010000:3.0:1782239949.911174:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782239949.911196:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044a00/0x8c5345f1c1ec4f73 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e4ca expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239949.911264:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044000/0x8c5345f1c1ec4f7a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239949.911278:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044000/0x8c5345f1c1ec4f7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239949.911289:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044000/0x8c5345f1c1ec4f7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782239949.911349:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1782239949.911354:0:5790:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1782239949.911412:0:5790:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044000/0x8c5345f1c1ec4f7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239949.911437:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044a00/0x8c5345f1c1ec4f73 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e4ca expref: 11 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239949.911456:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044000/0x8c5345f1c1ec4f7a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e4ca expref: 10 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239949.911466:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bb5d0df4400) 00010000:00010000:3.0:1782239949.911469:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782239949.911472:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb602044000, rc 0) 00000100:00100000:3.0:1782239949.911535:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ffd6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+10:10265:x1868813737945984:12345-192.168.203.32@tcp:101:lctl.0 Request processed in 384us (815us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239949.911543:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 38 00000100:00100000:1.0:1782239949.984407:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239949.984533:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737946112 00000100:00100000:2.0:1782239949.984546:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737946112 00000100:00100000:2.0:1782239949.984624:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 39 00000100:00100000:2.0:1782239949.984641:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ffd6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+10:10271:x1868813737946112:12345-192.168.203.32@tcp:101:bash.0 00010000:00010000:2.0:1782239949.984674:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782239949.984704:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e400/0x8c5345f1c1ec4f81 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e4d1 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239949.984859:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ee00/0x8c5345f1c1ec4f88 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239949.984877:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ee00/0x8c5345f1c1ec4f88 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239949.984892:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ee00/0x8c5345f1c1ec4f88 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239949.984907:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fc00/0x8c5345f1c1ec4f8f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239949.984915:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fc00/0x8c5345f1c1ec4f8f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239949.984921:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fc00/0x8c5345f1c1ec4f8f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239949.985267:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29f600/0x8c5345f1c1ec4f96 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239949.985276:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29f600/0x8c5345f1c1ec4f96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239949.985303:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29f600/0x8c5345f1c1ec4f96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782239949.985340:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:2.0:1782239949.985343:0:5792:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782239949.985388:0:5792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29f600/0x8c5345f1c1ec4f96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239949.985401:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ee00/0x8c5345f1c1ec4f88 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239949.985408:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ee00/0x8c5345f1c1ec4f88 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239949.985416:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ee00/0x8c5345f1c1ec4f88 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239949.985422:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5ee29ee00 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:2.0:1782239949.985426:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ee00/0x8c5345f1c1ec4f88 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239949.985433:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ee00/0x8c5345f1c1ec4f88 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239949.985446:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bb5d0df4400) 00010000:00010000:2.0:1782239949.985449:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782239949.985454:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ee00/0x8c5345f1c1ec4f88 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239949.985460:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ee00/0x8c5345f1c1ec4f88 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239949.985483:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fc00/0x8c5345f1c1ec4f8f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239949.985490:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fc00/0x8c5345f1c1ec4f8f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239949.985496:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fc00/0x8c5345f1c1ec4f8f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239949.985501:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5ee29fc00 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:2.0:1782239949.985504:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fc00/0x8c5345f1c1ec4f8f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239949.985509:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fc00/0x8c5345f1c1ec4f8f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239949.985516:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9bb5c4ed6d00) 00010000:00010000:2.0:1782239949.985518:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782239949.985521:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fc00/0x8c5345f1c1ec4f8f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239949.985526:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fc00/0x8c5345f1c1ec4f8f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239949.985560:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e400/0x8c5345f1c1ec4f81 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e4d1 expref: 12 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239949.985573:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29f600/0x8c5345f1c1ec4f96 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e4d1 expref: 11 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239949.985592:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bb5c4ed6b00) 00010000:00010000:2.0:1782239949.985594:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1782239949.985597:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5ee29f600, rc 0) 00000100:00100000:2.0:1782239949.985676:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ffd6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+11:10271:x1868813737946112:12345-192.168.203.32@tcp:101:bash.0 Request processed in 1038us (1291us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239949.985685:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 39 00000100:00100000:1.0:1782239949.992134:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239949.992247:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737946368 00000100:00100000:2.0:1782239949.992262:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737946368 00000100:00100000:2.0:1782239949.992341:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 40 00000100:00100000:2.0:1782239949.992354:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ffd6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+11:10271:x1868813737946368:12345-192.168.203.32@tcp:101:bash.0 00010000:00010000:2.0:1782239949.992382:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782239949.992426:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e400/0x8c5345f1c1ec4f9d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e4d8 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239949.992931:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fc00/0x8c5345f1c1ec4fa4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239949.993214:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fc00/0x8c5345f1c1ec4fa4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239949.993232:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fc00/0x8c5345f1c1ec4fa4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239949.993253:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ee00/0x8c5345f1c1ec4fab lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239949.993261:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ee00/0x8c5345f1c1ec4fab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239949.993292:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ee00/0x8c5345f1c1ec4fab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782239949.994930:0:5791:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:2.0:1782239949.995205:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e200/0x8c5345f1c1ec4fb2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239949.995225:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e200/0x8c5345f1c1ec4fb2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239949.995239:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e200/0x8c5345f1c1ec4fb2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239949.995284:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fc00/0x8c5345f1c1ec4fa4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239949.995292:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fc00/0x8c5345f1c1ec4fa4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239949.995301:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fc00/0x8c5345f1c1ec4fa4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239949.995307:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5ee29fc00 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:2.0:1782239949.995312:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fc00/0x8c5345f1c1ec4fa4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239949.995321:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fc00/0x8c5345f1c1ec4fa4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239949.995337:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bb5c4ed6b00) 00010000:00010000:2.0:1782239949.995340:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782239949.995359:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fc00/0x8c5345f1c1ec4fa4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239949.995366:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fc00/0x8c5345f1c1ec4fa4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782239949.995385:0:5791:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b8064164 reply state 00000000dccf094a transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ee00/0x8c5345f1c1ec4fab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239949.995408:0:5791:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1782239949.995463:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e400/0x8c5345f1c1ec4f9d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e4d8 expref: 14 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239949.995480:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e200/0x8c5345f1c1ec4fb2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e4d8 expref: 13 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239949.995498:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bb5c4ed6200) 00010000:00010000:2.0:1782239949.995501:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782239949.995504:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5ee29e200, rc 0) 00000100:00100000:2.0:1782239949.995637:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ffd6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+14:10271:x1868813737946368:12345-192.168.203.32@tcp:101:bash.0 Request processed in 3286us (3529us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1782239949.995647:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 40 00010000:00010000:2.0:1782239949.998637:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ee00/0x8c5345f1c1ec4fab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239949.998663:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ee00/0x8c5345f1c1ec4fab lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239949.998671:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ee00/0x8c5345f1c1ec4fab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239949.998701:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5ee29ee00 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:2.0:1782239949.998707:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ee00/0x8c5345f1c1ec4fab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239949.998716:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ee00/0x8c5345f1c1ec4fab lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239949.998738:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bb5c4ed6d00) 00010000:00010000:2.0:1782239949.998741:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782239949.998764:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ee00/0x8c5345f1c1ec4fab lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239949.998773:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ee00/0x8c5345f1c1ec4fab lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239950.001147:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239950.001329:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737946496 00000100:00100000:3.0:1782239950.001342:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737946496 00000100:00100000:3.0:1782239950.001401:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 20 00000100:00100000:3.0:1782239950.001412:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ded64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2343:x1868813737946496:12345-192.168.203.32@tcp:8:bash.0 00010000:00080000:3.0:1782239950.001462:0:6589:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 36dd742b-25b8-431e-bf41-75f2fff47ffb@192.168.203.32@tcp t0 exp 0000000000000000 cur 329 last 0 00000020:00000080:3.0:1782239950.001504:0:6589:0:(genops.c:1406:class_connect()) connect: client 36dd742b-25b8-431e-bf41-75f2fff47ffb, cookie 0x8c5345f1c1ec4fc0 00002000:00100000:3.0:1782239950.001520:0:6589:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 36dd742b-25b8-431e-bf41-75f2fff47ffb/ffff9bb5f7cda800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1782239950.001535:0:6589:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1782239950.001918:0:6589:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1782239950.004006:0:6589:0:(import.c:65:import_set_state_nolock()) ffff9bb5cb15b000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782239950.004164:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ded64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+6:2343:x1868813737946496:12345-192.168.203.32@tcp:8:bash.0 Request processed in 2747us (3027us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239950.004201:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 20 00000100:00100000:1.0:1782239950.009024:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239950.009104:0:8312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737946624 00000100:00100000:2.0:1782239950.009125:0:8312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737946624 00000100:00100000:2.0:1782239950.009215:0:8312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 21 00000100:00100000:2.0:1782239950.009231:0:8312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ded66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+6:0:x1868813737946624:12345-192.168.203.32@tcp:101:bash.0 00010000:00010000:2.0:1782239950.009254:0:8312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782239950.009285:0:8312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bc6d4b59/0x8c5345f1c1ec4fc7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e4df expref: -99 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782239950.009319:0:8312:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782239950.009341:0:8312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=329s v=(0 0) 00010000:00010000:2.0:1782239950.009346:0:8312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782239950.009358:0:8312:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc6d4b59/0x8c5345f1c1ec4fc7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e4df expref: 7 pid: 8312 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.009403:0:8312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bc6d4b59/0x8c5345f1c1ec4fc7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e4df expref: 7 pid: 8312 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.009489:0:8312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5ee29e400, rc 0) 00000100:00080000:1.0:1782239950.009644:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782239950.009682:0:8312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ded66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+7:0:x1868813737946624:12345-192.168.203.32@tcp:101:bash.0 Request processed in 457us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239950.009692:0:8312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 21 00000100:00100000:1.0:1782239950.030089:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239950.030199:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737946752 00000100:00100000:3.0:1782239950.030214:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737946752 00000100:00100000:3.0:1782239950.030299:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 22 00000100:00100000:3.0:1782239950.030312:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ded65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+7:10271:x1868813737946752:12345-192.168.203.32@tcp:101:bash.0 00010000:00010000:3.0:1782239950.030341:0:6590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782239950.030371:0:6590:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bf745047/0x8c5345f1c1ec4fce lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e4e6 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239950.030570:0:6590:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bc6d4b59/0x8c5345f1c1ec4fc7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e4df expref: 8 pid: 8312 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239950.030582:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782239950.030587:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782239950.030594:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf745047/0x8c5345f1c1ec4fce lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e4e6 expref: 8 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239950.030645:0:6590:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bc6d4b59/0x8c5345f1c1ec4fc7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e4df expref: 8 pid: 8312 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239950.030662:0:6590:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bc6d4b59/0x8c5345f1c1ec4fc7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e4df expref: 8 pid: 8312 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239950.030682:0:6590:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f779f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6590:1868813758955648:192.168.203.32@tcp:104: 00000100:00100000:3.0:1782239950.030896:0:6590:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c50a6a80 going to sleep for 11 seconds 00000100:00100000:0.0:1782239950.042218:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239950.042331:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737946880 00000100:00100000:1.0:1782239950.042344:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737946880 00010000:00010000:1.0:1782239950.042457:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bc6d4b59/0x8c5345f1c1ec4fc7 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e4df expref: 9 pid: 8312 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239950.042563:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 35 00000100:00100000:1.0:1782239950.042577:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f77f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+9:2345:x1868813737946880:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782239950.042597:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782239950.042643:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bc6d4b59/0x8c5345f1c1ec4fc7 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e4df expref: 9 pid: 8312 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239950.042661:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bc6d4b59/0x8c5345f1c1ec4fc7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e4df expref: 9 pid: 8312 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239950.042696:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782239950.042702:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782239950.042712:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bf745047/0x8c5345f1c1ec4fce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e4e6 expref: 9 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239950.042724:0:5775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf745047/0x8c5345f1c1ec4fce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e4e6 expref: 9 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239950.042865:0:5775:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000bf745047/0x8c5345f1c1ec4fce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e4e6 expref: 9 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239950.042886:0:5775:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5ded64e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5775:1868813758955776:192.168.203.32@tcp:105: 00000100:00100000:1.0:1782239950.043044:0:5775:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5f7c1ca80 going to sleep for 11 seconds 00010000:00010000:3.0:1782239950.043224:0:6590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bc6d4b59/0x8c5345f1c1ec4fc7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e4df expref: 9 pid: 8312 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239950.043243:0:6590:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f779f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6590:1868813758955648:192.168.203.32@tcp:104: 00010000:00010000:3.0:1782239950.043273:0:6590:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bf745047/0x8c5345f1c1ec4fce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e4e6 expref: 8 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239950.043286:0:6590:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb602044a00, rc 0) 00000100:00100000:3.0:1782239950.043320:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ded65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+8:10271:x1868813737946752:12345-192.168.203.32@tcp:101:bash.0 Request processed in 13011us (13246us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239950.043329:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 22 00010000:00010000:3.0:1782239950.047920:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782239950.049547:0:5775:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5ded64e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5775:1868813758955776:192.168.203.32@tcp:105: 00010000:00010000:0.0:1782239950.049581:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782239950.049656:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f77f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+7:2345:x1868813737946880:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 7080us (7453us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239950.049671:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 35 00000100:00100000:2.0:1782239950.057434:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239950.057689:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737947136 00000100:00100000:0.0:1782239950.057704:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737947136 00000100:00100000:0.0:1782239950.057821:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 6 00000100:00100000:0.0:1782239950.057834:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8eeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+13:10271:x1868813737947136:12345-192.168.203.32@tcp:35:bash.0 00000100:00100000:0.0:1782239950.058314:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8eeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+14:10271:x1868813737947136:12345-192.168.203.32@tcp:35:bash.0 Request processed in 481us (894us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1782239950.058324:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 6 00000100:00100000:1.0:1782239950.144905:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239950.145012:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737947392 00000100:00100000:3.0:1782239950.145026:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737947392 00000100:00100000:3.0:1782239950.145099:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 41 00000100:00100000:3.0:1782239950.145111:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ded67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+14:10281:x1868813737947392:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:3.0:1782239950.145158:0:6611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782239950.145187:0:6611:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602045000/0x8c5345f1c1ec4fd5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e4ed expref: -99 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782239950.145373:0:6611:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1782239950.146020:0:6611:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602045000/0x8c5345f1c1ec4fd5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e4ed expref: 16 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239950.146040:0:6611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bb5d0df4400) 00010000:00010000:3.0:1782239950.146044:0:6611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782239950.146072:0:6611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602045000/0x8c5345f1c1ec4fd5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e4ed expref: 16 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239950.146094:0:6611:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb602045000, rc 0) 00000100:00100000:2.0:1782239950.147058:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ded67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+15:10281:x1868813737947392:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 1941us (2160us total) trans 4294967313 rc 301/301 00000100:00100000:2.0:1782239950.147072:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 41 00000100:00100000:1.0:1782239950.160453:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239950.163772:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737947648 00000100:00100000:0.0:1782239950.163798:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737947648 00000100:00100000:0.0:1782239950.163899:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 7 00000100:00100000:0.0:1782239950.163915:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ded67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+15:10281:x1868813737947648:12345-192.168.203.32@tcp:35:lfs.0 00000100:00100000:0.0:1782239950.164315:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ded67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+16:10281:x1868813737947648:12345-192.168.203.32@tcp:35:lfs.0 Request processed in 403us (3877us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1782239950.165573:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 7 00000100:00100000:1.0:1782239950.261908:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239950.262070:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737947776 00000100:00100000:3.0:1782239950.262083:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737947776 00000100:00100000:3.0:1782239950.262166:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 42 00000100:00100000:3.0:1782239950.262178:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ded66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+16:10287:x1868813737947776:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:3.0:1782239950.262212:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782239950.262240:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602045000/0x8c5345f1c1ec4fe3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e4f4 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239950.262326:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044e00/0x8c5345f1c1ec4fea lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239950.262344:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044e00/0x8c5345f1c1ec4fea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239950.262357:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044e00/0x8c5345f1c1ec4fea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782239950.262448:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:3.0:1782239950.262452:0:5790:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1782239950.262478:0:5790:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044e00/0x8c5345f1c1ec4fea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239950.262648:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602045000/0x8c5345f1c1ec4fe3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e4f4 expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239950.262673:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044e00/0x8c5345f1c1ec4fea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e4f4 expref: 17 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239950.262703:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bb5c4ed6b00) 00010000:00010000:3.0:1782239950.262706:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782239950.262711:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb602044e00, rc 0) 00000100:00100000:3.0:1782239950.262984:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ded66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+17:10287:x1868813737947776:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 807us (1088us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239950.262993:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 42 00000100:00100000:1.0:1782239950.266780:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239950.266947:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737948032 00000100:00100000:2.0:1782239950.266959:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737948032 00000100:00100000:2.0:1782239950.267036:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 43 00000100:00100000:2.0:1782239950.267048:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ded65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+17:10287:x1868813737948032:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:2.0:1782239950.267075:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782239950.267109:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fc00/0x8c5345f1c1ec4ff1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e4fb expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.267248:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec4ff8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.267266:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec4ff8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.267280:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec4ff8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782239950.267306:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1782239950.267479:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fc00/0x8c5345f1c1ec4ff1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e4fb expref: 20 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.267501:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec4ff8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e4fb expref: 19 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.267512:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bb5c4ed6200) 00010000:00010000:2.0:1782239950.267515:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782239950.267519:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5ee29ea00, rc 0) 00000100:00100000:2.0:1782239950.267595:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ded65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+19:10287:x1868813737948032:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 549us (858us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1782239950.267604:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 43 00000100:00100000:1.0:1782239950.272659:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239950.272706:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239950.276987:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737948416 00000100:00100000:2.0:1782239950.277009:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737948416 00000100:00100000:2.0:1782239950.277125:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 2 00000100:00100000:2.0:1782239950.277139:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ded67800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+19:2347:x1868813737948416:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782239950.277161:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782239950.277195:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec4ff8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e4fb expref: 19 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.277223:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bb5c4ed6200) 00010000:00010000:2.0:1782239950.277229:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782239950.277313:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ded67800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+18:2347:x1868813737948416:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 177us (4668us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239950.277322:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 2 00000100:00100000:3.0:1782239950.277567:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737948288 00000100:00100000:3.0:1782239950.277573:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737948288 00000100:00100000:3.0:1782239950.277614:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 44 00000100:00100000:3.0:1782239950.277621:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ded64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+18:10287:x1868813737948288:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:3.0:1782239950.277648:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782239950.277668:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44c00/0x8c5345f1c1ec5006 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e502 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239950.277807:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec500d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239950.277826:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec500d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239950.277838:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec500d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782239950.277853:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1782239950.278007:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44c00/0x8c5345f1c1ec5006 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e502 expref: 21 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239950.278038:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec500d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e502 expref: 20 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239950.278047:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bb5c4ed6200) 00010000:00010000:3.0:1782239950.278050:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1782239950.278053:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5c2a44000, rc 0) 00000100:00100000:3.0:1782239950.278089:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ded64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+20:10287:x1868813737948288:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 468us (5381us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1782239950.278096:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 44 00000100:00100000:3.0:1782239950.282466:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239950.282568:0:8312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737948544 00000100:00100000:2.0:1782239950.282580:0:8312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737948544 00000100:00100000:2.0:1782239950.282657:0:8312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 23 00000100:00100000:2.0:1782239950.282669:0:8312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f779f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+7:2344:x1868813737948544:12345-192.168.203.32@tcp:1:lfs.0 00010000:00010000:2.0:1782239950.282727:0:8312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f4fd7be0/0x8c5345f1c1ec501b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.282777:0:8312:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bf745047/0x8c5345f1c1ec4fce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e4e6 expref: 7 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.282787:0:8312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782239950.282791:0:8312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782239950.282796:0:8312:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f4fd7be0/0x8c5345f1c1ec501b lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.282841:0:8312:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bf745047/0x8c5345f1c1ec4fce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e4e6 expref: 7 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.282857:0:8312:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bf745047/0x8c5345f1c1ec4fce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e4e6 expref: 7 pid: 6590 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239950.282876:0:8312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5e8eed500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8312:1868813758955904:192.168.203.32@tcp:104: 00000100:00100000:2.0:1782239950.283001:0:8312:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5d1cd0d80 going to sleep for 11 seconds 00000100:00100000:0.0:1782239950.289349:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239950.289656:0:8312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5e8eed500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8312:1868813758955904:192.168.203.32@tcp:104: 00010000:00010000:2.0:1782239950.289694:0:8312:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f4fd7be0/0x8c5345f1c1ec501b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239950.292981:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737948672 00000100:00100000:3.0:1782239950.293000:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737948672 00002000:00100000:3.0:1782239950.293065:0:6594:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff9bb5f77f0000 x1868813737948672/t0(0) o4->36dd742b-25b8-431e-bf41-75f2fff47ffb@192.168.203.32@tcp:551/0 lens 504/0 e 0 to 0 dl 1782239961 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1782239950.293078:0:6594:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9bb5f77f0000 with x1868813737948672 ext(0->12) 00010000:00010000:3.0:1782239950.293090:0:6594:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000bf745047/0x8c5345f1c1ec4fce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e4e6 expref: 8 pid: 6590 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239950.293150:0:6594:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000bf745047/0x8c5345f1c1ec4fce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e4e6 expref: 8 pid: 6590 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782239950.293160:0:6594:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9bb5f77f0000 00000100:00100000:3.0:1782239950.293203:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 0 00000100:00100000:3.0:1782239950.293216:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f77f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+8:2345:x1868813737948672:12345-192.168.203.32@tcp:4:lfs.0 00000001:00100000:2.0:1782239950.341777:0:7493:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 36dd742b-25b8-431e-bf41-75f2fff47ffb 00000100:00100000:3.0:1782239950.342575:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f77f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+9:2345:x1868813737948672:12345-192.168.203.32@tcp:4:lfs.0 Request processed in 49354us (53232us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1782239950.342588:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 0 00002000:00100000:3.0:1782239950.342602:0:6594:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff9bb5f77f0000 x1868813737948672/t4294967299(0) o4->36dd742b-25b8-431e-bf41-75f2fff47ffb@192.168.203.32@tcp:551/0 lens 504/448 e 0 to 0 dl 1782239961 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1782239950.342614:0:6594:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9bb5f77f0000 with x1868813737948672 ext(0->12) 00010000:00010000:3.0:1782239950.342625:0:6594:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000bf745047/0x8c5345f1c1ec4fce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e4e6 expref: 9 pid: 6590 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239950.342644:0:6594:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000bf745047/0x8c5345f1c1ec4fce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e4e6 expref: 9 pid: 6590 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782239950.342651:0:6594:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9bb5f77f0000 00000100:00100000:1.0:1782239950.345561:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239950.346038:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737948800 00000100:00100000:0.0:1782239950.346048:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737948800 00010000:00010000:0.0:1782239950.346089:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bf745047/0x8c5345f1c1ec4fce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e4e6 expref: 9 pid: 6590 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782239950.346199:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 36 00000100:00100000:0.0:1782239950.346210:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ded65180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+9:2347:x1868813737948800:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782239950.346225:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1782239950.346244:0:5777:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1782239950.346247:0:5777:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1782239950 00002000:00010000:0.0:1782239950.346249:0:5777:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1782239950 00002000:00010000:0.0:1782239950.346251:0:5777:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1782239950 00010000:00010000:0.0:1782239950.346257:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bf745047/0x8c5345f1c1ec4fce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e4e6 expref: 9 pid: 6590 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239950.346270:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bf745047/0x8c5345f1c1ec4fce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e4e6 expref: 9 pid: 6590 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239950.346295:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bf745047/0x8c5345f1c1ec4fce lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e4e6 expref: 9 pid: 6590 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239950.346313:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782239950.346317:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782239950.346322:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f4fd7be0/0x8c5345f1c1ec501b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239950.346331:0:5777:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f4fd7be0/0x8c5345f1c1ec501b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239950.346364:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782239950.346675:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ded65180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+8:2347:x1868813737948800:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 466us (1124us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239950.346684:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 36 00010000:00010000:2.0:1782239950.346763:0:8312:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f4fd7be0/0x8c5345f1c1ec501b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.346773:0:8312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f4fd7be0/0x8c5345f1c1ec501b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.346800:0:8312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f4fd7be0/0x8c5345f1c1ec501b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.346809:0:8312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f4fd7be0/0x8c5345f1c1ec501b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.346817:0:8312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f4fd7be0/0x8c5345f1c1ec501b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.346823:0:8312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5ee29fc00 already unused, calling callback (ffffffffc1728ce0) 00010000:00010000:2.0:1782239950.346827:0:8312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4fd7be0/0x8c5345f1c1ec501b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.346836:0:8312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4fd7be0/0x8c5345f1c1ec501b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.346848:0:8312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f4fd7be0/0x8c5345f1c1ec501b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.346865:0:8312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f4fd7be0/0x8c5345f1c1ec501b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239950.346924:0:8312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f779f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+7:2344:x1868813737948544:12345-192.168.203.32@tcp:1:lfs.0 Request processed in 64258us (64473us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239950.346933:0:8312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 23 00000100:00100000:3.0:1782239950.350015:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239950.350108:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737949056 00000100:00100000:2.0:1782239950.350125:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737949056 00000100:00100000:2.0:1782239950.350172:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 8 00000100:00100000:2.0:1782239950.350181:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f779ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+20:10287:x1868813737949056:12345-192.168.203.32@tcp:35:lfs.0 00000004:00010000:2.0:1782239950.350242:0:5793:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec500d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e502 expref: 20 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782239950.350539:0:5793:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:2.0:1782239950.350598:0:5793:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:2.0:1782239950.351262:0:5793:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:2.0:1782239950.351328:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec5022 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.351346:0:5793:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e200/0x8c5345f1c1ec4fb2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e4d8 expref: 24 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.351355:0:5793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec5022 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.351395:0:5793:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e200/0x8c5345f1c1ec4fb2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e4d8 expref: 24 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.351422:0:5793:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e200/0x8c5345f1c1ec4fb2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e4d8 expref: 24 pid: 5791 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239950.351438:0:5793:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5e8eed500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5793:1868813758956032:192.168.203.32@tcp:104: 00000100:00100000:2.0:1782239950.351547:0:5793:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5e8c9a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782239950.355179:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239950.355339:0:5793:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5e8eed500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5793:1868813758956032:192.168.203.32@tcp:104: 00010000:00010000:2.0:1782239950.355366:0:5793:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec5022 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239950.355431:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737949184 00000100:00100000:1.0:1782239950.355451:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737949184 00010000:00010000:1.0:1782239950.355495:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e200/0x8c5345f1c1ec4fb2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e4d8 expref: 25 pid: 5791 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239950.355532:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 37 00000100:00100000:1.0:1782239950.355555:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f779c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+25:2344:x1868813737949184:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782239950.355569:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782239950.355576:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e200/0x8c5345f1c1ec4fb2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e4d8 expref: 25 pid: 5791 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239950.355588:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e200/0x8c5345f1c1ec4fb2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e4d8 expref: 25 pid: 5791 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239950.355611:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e200/0x8c5345f1c1ec4fb2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e4d8 expref: 25 pid: 5791 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239950.355625:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bb5c4ed6200) 00010000:00010000:1.0:1782239950.355630:0:5776:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec5022 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239950.355639:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec5022 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239950.355647:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec5022 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239950.355827:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782239950.355884:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f779c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+24:2344:x1868813737949184:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 343us (713us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239950.355900:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 37 00010000:00010000:2.0:1782239950.356169:0:5793:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec5022 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.356176:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec5022 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782239950.356302:0:5793:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:2.0:1782239950.356998:0:5793:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:2.0:1782239950.357142:0:5793:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5e8eed500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5793:1868813758956160:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1782239950.357193:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239950.357224:0:5793:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5e8c9a840 going to sleep for 11 seconds 00000100:00100000:1.0:1782239950.357292:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758956160 00000100:00100000:1.0:1782239950.357299:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758956160 00000100:00100000:1.0:1782239950.357343:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782239950.357351:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8eed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5793:x1868813758956160:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1782239950.357441:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8eed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5793:x1868813758956160:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 90us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239950.357449:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782239950.357925:0:5793:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5e8eed500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5793:1868813758956160:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1782239950.358840:0:5793:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:0.0:1782239950.358929:0:5793:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f7c0ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5793:1868813758956288:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1782239950.358979:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239950.359006:0:5793:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c886ccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1782239950.359162:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758956288 00000100:00100000:1.0:1782239950.359169:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758956288 00000100:00100000:1.0:1782239950.359252:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782239950.359261:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7c0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5793:x1868813758956288:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1782239950.359477:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7c0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5793:x1868813758956288:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 209us (488us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1782239950.359486:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782239950.359728:0:5793:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f7c0ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5793:1868813758956288:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1782239950.360735:0:5793:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:0.0:1782239950.360823:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec5022 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239950.360834:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec5022 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239950.360841:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec5022 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239950.360846:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5ee29ea00 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:0.0:1782239950.360850:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec5022 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239950.360858:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec5022 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239950.360873:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bb5c4ed6200) 00010000:00010000:0.0:1782239950.360876:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1782239950.360880:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec5022 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239950.360898:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec5022 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782239950.361081:0:5793:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1782239950.361312:0:5793:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:0.0:1782239950.361325:0:5793:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 329433575658ns, next at 330433573459ns, rc = 0 00000001:00080000:0.0:1782239950.361332:0:5793:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:0.0:1782239950.361363:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bb5c4ed6200) 00010000:00010000:0.0:1782239950.361366:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1782239950.361374:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec500d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e502 expref: 28 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782239950.361486:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f779ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+27:10287:x1868813737949056:12345-192.168.203.32@tcp:35:lfs.0 Request processed in 11304us (11478us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1782239950.361496:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 8 00000020:00080000:0.0:1782239950.361500:0:5793:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1782239950.364799:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239950.364846:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737949312 00000100:00100000:2.0:1782239950.364857:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737949312 00000100:00100000:2.0:1782239950.364919:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 45 00000100:00100000:2.0:1782239950.364929:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f779ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+27:10287:x1868813737949312:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:2.0:1782239950.364952:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782239950.364975:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ec00/0x8c5345f1c1ec5029 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e509 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.365051:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ec00/0x8c5345f1c1ec5029 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e509 expref: 28 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.365064:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ec00/0x8c5345f1c1ec5029 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e509 expref: 28 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.365081:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bb5c4ed6a00) 00010000:00010000:2.0:1782239950.365084:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782239950.365088:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5ee29ec00, rc 0) 00000100:00100000:2.0:1782239950.365157:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f779ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+28:10287:x1868813737949312:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 229us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239950.365163:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 45 00000100:00100000:2.0:1782239950.368306:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239950.368387:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737949568 00000100:00100000:3.0:1782239950.368406:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737949568 00000100:00100000:3.0:1782239950.368462:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 9 00000100:00100000:3.0:1782239950.368472:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5c77e2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+28:10287:x1868813737949568:12345-192.168.203.32@tcp:35:lfs.0 00000100:00100000:3.0:1782239950.368721:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5c77e2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+29:10287:x1868813737949568:12345-192.168.203.32@tcp:35:lfs.0 Request processed in 249us (423us total) trans 4294967326 rc 0/0 00000100:00100000:3.0:1782239950.368730:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 9 00000100:00100000:3.0:1782239950.452145:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239950.452358:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737949824 00000100:00100000:2.0:1782239950.452369:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737949824 00000100:00100000:2.0:1782239950.452439:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 46 00000100:00100000:2.0:1782239950.452449:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f779ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+29:10297:x1868813737949824:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:2.0:1782239950.452473:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782239950.452502:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29f200/0x8c5345f1c1ec5030 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e510 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782239950.452623:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1782239950.453019:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29f200/0x8c5345f1c1ec5030 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e510 expref: 31 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.453035:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bb5d0df4400) 00010000:00010000:2.0:1782239950.453051:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782239950.453057:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29f200/0x8c5345f1c1ec5030 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e510 expref: 31 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.453073:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5ee29f200, rc 0) 00000100:00100000:2.0:1782239950.453154:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f779ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+30:10297:x1868813737949824:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 706us (1017us total) trans 4294967327 rc 301/301 00000100:00100000:2.0:1782239950.453162:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 46 00000100:00100000:1.0:1782239950.456249:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239950.456339:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737949952 00000100:00100000:2.0:1782239950.456348:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737949952 00000100:00100000:2.0:1782239950.456506:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 47 00000100:00100000:2.0:1782239950.456518:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ded66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+30:10297:x1868813737949952:12345-192.168.203.32@tcp:34:lfs.0 00010000:00010000:2.0:1782239950.456606:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec503e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.456623:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec503e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.456634:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec503e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.456651:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e200/0x8c5345f1c1ec5045 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.456659:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e200/0x8c5345f1c1ec5045 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.456665:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e200/0x8c5345f1c1ec5045 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.456916:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fc00/0x8c5345f1c1ec504c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.456938:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fc00/0x8c5345f1c1ec504c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.456946:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fc00/0x8c5345f1c1ec504c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782239950.456989:0:5792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fc00/0x8c5345f1c1ec504c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.457002:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec503e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.457009:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec503e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.457015:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec503e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.457021:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5ee29ea00 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:2.0:1782239950.457025:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec503e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.457033:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec503e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.457044:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bb5c4ed6b00) 00010000:00010000:2.0:1782239950.457047:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782239950.457052:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec503e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.457059:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec503e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.457079:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e200/0x8c5345f1c1ec5045 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.457085:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e200/0x8c5345f1c1ec5045 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.457091:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e200/0x8c5345f1c1ec5045 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.457096:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5ee29e200 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:2.0:1782239950.457099:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e200/0x8c5345f1c1ec5045 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.457106:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e200/0x8c5345f1c1ec5045 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.457126:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bb5c4ed6900) 00010000:00010000:2.0:1782239950.457129:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782239950.457132:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e200/0x8c5345f1c1ec5045 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.457138:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e200/0x8c5345f1c1ec5045 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.457153:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fc00/0x8c5345f1c1ec504c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.457159:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fc00/0x8c5345f1c1ec504c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.457165:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fc00/0x8c5345f1c1ec504c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.457176:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5ee29fc00 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:2.0:1782239950.457179:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fc00/0x8c5345f1c1ec504c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.457185:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fc00/0x8c5345f1c1ec504c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.457194:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bb5c4ed6a00) 00010000:00010000:2.0:1782239950.457196:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782239950.457199:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fc00/0x8c5345f1c1ec504c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.457205:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fc00/0x8c5345f1c1ec504c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239950.457289:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ded66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+30:10297:x1868813737949952:12345-192.168.203.32@tcp:34:lfs.0 Request processed in 773us (1051us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239950.457298:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 47 00000100:00100000:3.0:1782239950.459554:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239950.460306:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737950208 00000100:00100000:0.0:1782239950.460318:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737950208 00000100:00100000:0.0:1782239950.460424:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 10 00000100:00100000:0.0:1782239950.460435:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f779c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+30:10297:x1868813737950208:12345-192.168.203.32@tcp:35:lfs.0 00000100:00100000:0.0:1782239950.460734:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f779c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+31:10297:x1868813737950208:12345-192.168.203.32@tcp:35:lfs.0 Request processed in 300us (1199us total) trans 4294967328 rc 0/0 00000100:00100000:0.0:1782239950.460741:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 10 00000100:00100000:3.0:1782239950.505656:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239950.505804:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737950464 00000100:00100000:2.0:1782239950.505815:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737950464 00000100:00100000:2.0:1782239950.505880:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 48 00000100:00100000:2.0:1782239950.505892:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f779e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+31:10300:x1868813737950464:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:2.0:1782239950.505918:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782239950.505939:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fc00/0x8c5345f1c1ec5053 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e517 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.506025:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e200/0x8c5345f1c1ec505a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.506060:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e200/0x8c5345f1c1ec505a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.506072:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e200/0x8c5345f1c1ec505a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.506088:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec5061 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.506095:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec5061 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.506101:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec5061 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.506242:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29f200/0x8c5345f1c1ec5068 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.506252:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29f200/0x8c5345f1c1ec5068 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.506260:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29f200/0x8c5345f1c1ec5068 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782239950.506270:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1782239950.506359:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e200/0x8c5345f1c1ec505a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.506366:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e200/0x8c5345f1c1ec505a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.506373:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e200/0x8c5345f1c1ec505a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.506385:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5ee29e200 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:2.0:1782239950.506389:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e200/0x8c5345f1c1ec505a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.506396:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e200/0x8c5345f1c1ec505a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.506408:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bb5c4ed6b00) 00010000:00010000:2.0:1782239950.506411:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782239950.506415:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e200/0x8c5345f1c1ec505a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.506421:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e200/0x8c5345f1c1ec505a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.506434:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec5061 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.506440:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec5061 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.506446:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec5061 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.506451:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5ee29ea00 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:2.0:1782239950.506454:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec5061 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.506459:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec5061 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.506476:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bb5c4ed6900) 00010000:00010000:2.0:1782239950.506479:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782239950.506482:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec5061 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.506487:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec5061 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.506530:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fc00/0x8c5345f1c1ec5053 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e517 expref: 34 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.506543:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29f200/0x8c5345f1c1ec5068 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e517 expref: 33 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.506550:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bb5c4ed6a00) 00010000:00010000:2.0:1782239950.506552:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782239950.506554:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5ee29f200, rc 0) 00000100:00100000:2.0:1782239950.506624:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f779e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+33:10300:x1868813737950464:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 734us (981us total) trans 4294967329 rc 0/0 00000100:00100000:2.0:1782239950.506631:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 48 00000100:00100000:1.0:1782239950.511603:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239950.511684:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737950592 00000100:00100000:2.0:1782239950.511694:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737950592 00000100:00100000:2.0:1782239950.511790:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 49 00000100:00100000:2.0:1782239950.511800:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ded65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+33:10300:x1868813737950592:12345-192.168.203.32@tcp:54:lfs.0 00010000:00010000:2.0:1782239950.511869:0:6611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fc00/0x8c5345f1c1ec5076 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.511887:0:6611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fc00/0x8c5345f1c1ec5076 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.511910:0:6611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fc00/0x8c5345f1c1ec5076 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.511938:0:6611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fc00/0x8c5345f1c1ec5076 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.511944:0:6611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fc00/0x8c5345f1c1ec5076 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.511950:0:6611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fc00/0x8c5345f1c1ec5076 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.511956:0:6611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5ee29fc00 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:2.0:1782239950.511959:0:6611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fc00/0x8c5345f1c1ec5076 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.511966:0:6611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fc00/0x8c5345f1c1ec5076 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.512000:0:6611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bb5c4ed6a00) 00010000:00010000:2.0:1782239950.512004:0:6611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782239950.512009:0:6611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fc00/0x8c5345f1c1ec5076 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.512014:0:6611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fc00/0x8c5345f1c1ec5076 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239950.512094:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ded65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+33:10300:x1868813737950592:12345-192.168.203.32@tcp:54:lfs.0 Request processed in 294us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239950.512102:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 49 00000100:00100000:1.0:1782239950.516848:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239950.517036:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737950848 00000100:00100000:3.0:1782239950.517048:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737950848 00000100:00100000:3.0:1782239950.517095:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 11 00000100:00100000:3.0:1782239950.517102:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ded65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+33:10300:x1868813737950848:12345-192.168.203.32@tcp:35:lfs.0 00000100:00100000:3.0:1782239950.518226:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ded65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+34:10300:x1868813737950848:12345-192.168.203.32@tcp:35:lfs.0 Request processed in 1117us (1381us total) trans 4294967330 rc 0/0 00000100:00100000:3.0:1782239950.518239:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 11 00000001:00080000:0.0:1782239950.722904:0:5812:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967328 is committed 00000004:00080000:0.0:1782239950.722918:0:5812:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:0.0:1782239950.722940:0:5812:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bb5c886cf00 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:0.0:1782239950.722945:0:5812:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9bb5d2014000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bb5c886c300 00000020:00080000:0.0:1782239950.722966:0:5812:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9bb5cf436a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bb5f7e2b800 00000001:00080000:0.0:1782239950.723004:0:5812:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967329 is committed 00000001:00080000:0.0:1782239950.723035:0:5812:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967330 is committed 00000100:00100000:2.0:1782239950.723321:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782239950.723356:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5e8eeca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1868813758956416:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1782239950.723448:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239950.723520:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758956416 00000100:00100000:2.0:1782239950.723527:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758956416 00000100:00100000:2.0:1782239950.723569:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1782239950.723577:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8eed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3304:x1868813758956416:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1782239950.723603:0:6589:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:2.0:1782239950.723632:0:6589:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a3ad2ce, atime: 0x6a3ad2ce, ctime: 0x6a3ad2ce, blocks: 0x1 00010000:00010000:2.0:1782239950.723641:0:6589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f4fd7be0/0x8c5345f1c1ec507d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.723656:0:6589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=329s v=(0 0) 00010000:00010000:2.0:1782239950.723660:0:6589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782239950.723665:0:6589:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f4fd7be0/0x8c5345f1c1ec507d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.723678:0:6589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f4fd7be0/0x8c5345f1c1ec507d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.723689:0:6589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f4fd7be0/0x8c5345f1c1ec507d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.723698:0:6589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f4fd7be0/0x8c5345f1c1ec507d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.723718:0:6589:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000020:00080000:1.0:1782239950.723883:0:5823:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:1.0:1782239950.723995:0:5823:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00010000:00010000:3.0:1782239950.724140:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782239950.724147:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f4fd7be0/0x8c5345f1c1ec507d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239950.724159:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5ee29fc00 already unused, calling callback (ffffffffc1728ce0) 00010000:00010000:3.0:1782239950.724164:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4fd7be0/0x8c5345f1c1ec507d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239950.724175:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4fd7be0/0x8c5345f1c1ec507d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239950.724200:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f4fd7be0/0x8c5345f1c1ec507d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239950.724207:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f4fd7be0/0x8c5345f1c1ec507d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239950.724230:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782239950.724232:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782239950.724242:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782239950.727177:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8eed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3304:x1868813758956416:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3590us (3718us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1782239950.727204:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000004:00080000:3.0:1782239950.730162:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bb5e8eeca80/2, rc 0, transno 4294967301 00000100:00100000:3.0:1782239950.730177:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5e8eeca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1868813758956416:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782239950.870595:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239950.870798:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737951104 00000100:00100000:2.0:1782239950.870808:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737951104 00000100:00100000:2.0:1782239950.870928:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 50 00000100:00100000:2.0:1782239950.870941:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7c0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+12:10331:x1868813737951104:12345-192.168.203.32@tcp:101:cat.0 00010000:00010000:2.0:1782239950.870966:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782239950.870987:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec5084 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e51e expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.871088:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e200/0x8c5345f1c1ec508b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.871102:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e200/0x8c5345f1c1ec508b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.871124:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e200/0x8c5345f1c1ec508b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782239950.871136:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1782239950.871378:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec5084 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e51e expref: 15 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.871396:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e200/0x8c5345f1c1ec508b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e51e expref: 14 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.871405:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bb5c4ed6a00) 00010000:00010000:2.0:1782239950.871408:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782239950.871411:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5ee29e200, rc 0) 00000100:00100000:2.0:1782239950.871502:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7c0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+14:10331:x1868813737951104:12345-192.168.203.32@tcp:101:cat.0 Request processed in 564us (914us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1782239950.871511:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 50 00000100:00100000:1.0:1782239950.876933:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239950.877062:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239950.879100:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737951488 00000100:00100000:3.0:1782239950.879122:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737951488 00000100:00100000:3.0:1782239950.879204:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 12 00000100:00100000:3.0:1782239950.879215:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ded67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+14:10331:x1868813737951488:12345-192.168.203.32@tcp:35:cat.0 00000100:00100000:3.0:1782239950.879497:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ded67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+15:10331:x1868813737951488:12345-192.168.203.32@tcp:35:cat.0 Request processed in 283us (2433us total) trans 4294967332 rc 0/0 00000100:00100000:3.0:1782239950.879506:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 12 00000100:00100000:0.0:1782239950.883658:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737951232 00000100:00100000:0.0:1782239950.883672:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737951232 00000100:00100000:0.0:1782239950.884338:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 3 00000100:00100000:0.0:1782239950.884357:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d0218450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+15:2345:x1868813737951232:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782239950.884373:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782239950.884412:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e200/0x8c5345f1c1ec508b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e51e expref: 15 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239950.884431:0:5775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bb5c4ed6a00) 00010000:00010000:0.0:1782239950.884437:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782239950.884516:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d0218450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+14:2345:x1868813737951232:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 166us (7591us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239950.886576:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 3 00000100:00100000:1.0:1782239950.990966:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239950.991678:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737951744 00000100:00100000:2.0:1782239950.991691:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737951744 00000100:00100000:2.0:1782239950.991789:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 51 00000100:00100000:2.0:1782239950.991801:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ded66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+14:10337:x1868813737951744:12345-192.168.203.32@tcp:101:dd.0 00010000:00010000:2.0:1782239950.991825:0:6611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782239950.991828:0:6611:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1782239950.991855:0:6611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044e00/0x8c5345f1c1ec4fea lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e4f4 expref: 14 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.991885:0:6611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bb5c4ed6b00) 00010000:00010000:2.0:1782239950.991890:0:6611:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782239950.991903:0:6611:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec5099 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e525 expref: -99 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.992014:0:6611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fa00/0x8c5345f1c1ec50a0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.992027:0:6611:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29f200/0x8c5345f1c1ec5068 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e517 expref: 14 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.992035:0:6611:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fa00/0x8c5345f1c1ec50a0 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.992064:0:6611:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29f200/0x8c5345f1c1ec5068 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e517 expref: 14 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239950.992090:0:6611:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29f200/0x8c5345f1c1ec5068 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e517 expref: 14 pid: 5790 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239950.992104:0:6611:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f7ce3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6611:1868813758956544:192.168.203.32@tcp:104: 00000100:00100000:2.0:1782239950.992209:0:6611:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c50a6a80 going to sleep for 11 seconds 00000100:00100000:2.0:1782239950.994914:0:6611:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f7ce3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6611:1868813758956544:192.168.203.32@tcp:104: 00010000:00010000:2.0:1782239950.994946:0:6611:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fa00/0x8c5345f1c1ec50a0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239950.998740:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239951.003065:0:7481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737951872 00000100:00100000:3.0:1782239951.003081:0:7481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737951872 00010000:00010000:3.0:1782239951.003158:0:7481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29f200/0x8c5345f1c1ec5068 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e517 expref: 15 pid: 5790 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239951.003216:0:7481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 38 00000100:00100000:3.0:1782239951.003228:0:7481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ded64380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+15:2344:x1868813737951872:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782239951.003244:0:7481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782239951.003251:0:7481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29f200/0x8c5345f1c1ec5068 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e517 expref: 15 pid: 5790 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239951.003265:0:7481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29f200/0x8c5345f1c1ec5068 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e517 expref: 15 pid: 5790 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239951.003287:0:7481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29f200/0x8c5345f1c1ec5068 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e517 expref: 15 pid: 5790 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239951.003323:0:7481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bb5c4ed6a00) 00010000:00010000:3.0:1782239951.003329:0:7481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fa00/0x8c5345f1c1ec50a0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239951.003338:0:7481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fa00/0x8c5345f1c1ec50a0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239951.003346:0:7481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fa00/0x8c5345f1c1ec50a0 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239951.003374:0:7481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782239951.003460:0:7481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ded64380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+14:2344:x1868813737951872:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 233us (4729us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239951.003467:0:7481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 38 00010000:00010000:2.0:1782239951.003718:0:6611:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fa00/0x8c5345f1c1ec50a0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239951.003728:0:6611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fa00/0x8c5345f1c1ec50a0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782239951.003780:0:6611:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1782239951.003964:0:6611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec5099 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e525 expref: 15 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239951.003981:0:6611:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fa00/0x8c5345f1c1ec50a0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e525 expref: 14 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239951.003989:0:6611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bb5c4ed6a00) 00010000:00010000:2.0:1782239951.003992:0:6611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1782239951.003994:0:6611:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5ee29fa00, rc 0) 00000100:00100000:2.0:1782239951.004032:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ded66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+14:10337:x1868813737951744:12345-192.168.203.32@tcp:101:dd.0 Request processed in 12234us (13077us total) trans 4294967333 rc 0/0 00000100:00100000:2.0:1782239951.004051:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 51 00000100:00080000:1.0:1782239951.005415:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782239951.009248:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239951.009346:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737952128 00000100:00100000:3.0:1782239951.009356:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737952128 00000100:00100000:3.0:1782239951.009431:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 52 00000100:00100000:3.0:1782239951.009442:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ded64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+14:10337:x1868813737952128:12345-192.168.203.32@tcp:36:dd.0 00010000:00010000:3.0:1782239951.009807:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44200/0x8c5345f1c1ec50ae lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239951.009827:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44200/0x8c5345f1c1ec50ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239951.009838:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44200/0x8c5345f1c1ec50ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782239951.010329:0:5791:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:2.0:1782239951.010362:0:5791:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000922276a5 reply state 000000000e2af12f transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44200/0x8c5345f1c1ec50ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239951.010373:0:5791:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782239951.010491:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ded64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+17:10337:x1868813737952128:12345-192.168.203.32@tcp:36:dd.0 Request processed in 1049us (1251us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1782239951.010499:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 52 00000020:00080000:2.0:1782239951.010505:0:5791:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1782239951.014572:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44200/0x8c5345f1c1ec50ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239951.014589:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44200/0x8c5345f1c1ec50ae lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239951.014597:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44200/0x8c5345f1c1ec50ae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239951.014603:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5c2a44200 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:0.0:1782239951.014608:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44200/0x8c5345f1c1ec50ae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239951.014631:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44200/0x8c5345f1c1ec50ae lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239951.014647:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bb5c4ed6a00) 00010000:00010000:0.0:1782239951.014649:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782239951.014654:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44200/0x8c5345f1c1ec50ae lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239951.014671:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44200/0x8c5345f1c1ec50ae lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239951.071087:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782239951.374003:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239951.374145:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737952256 00000100:00100000:2.0:1782239951.374156:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737952256 00000100:00100000:2.0:1782239951.374217:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 53 00000100:00100000:2.0:1782239951.374227:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f779d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+16:10351:x1868813737952256:12345-192.168.203.32@tcp:101:stat.0 00010000:00010000:2.0:1782239951.374249:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782239951.374276:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec50b5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e52c expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239951.374357:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fe00/0x8c5345f1c1ec50bc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239951.374372:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fe00/0x8c5345f1c1ec50bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239951.374382:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fe00/0x8c5345f1c1ec50bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239951.374395:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e800/0x8c5345f1c1ec50c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239951.374413:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e800/0x8c5345f1c1ec50c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239951.374419:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e800/0x8c5345f1c1ec50c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239951.374711:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e600/0x8c5345f1c1ec50ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239951.374722:0:5792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fa00/0x8c5345f1c1ec50a0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e525 expref: 17 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239951.374731:0:5792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e600/0x8c5345f1c1ec50ca lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239951.377711:0:5792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fa00/0x8c5345f1c1ec50a0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e525 expref: 17 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239951.377731:0:5792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fa00/0x8c5345f1c1ec50a0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e525 expref: 17 pid: 6611 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239951.377769:0:5792:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f7ce3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5792:1868813758956672:192.168.203.32@tcp:104: 00000100:00100000:2.0:1782239951.379174:0:5792:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5e8c9a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782239951.388401:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239951.388445:0:5792:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f7ce3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5792:1868813758956672:192.168.203.32@tcp:104: 00010000:00010000:1.0:1782239951.388476:0:5792:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e600/0x8c5345f1c1ec50ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239951.388501:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737952512 00000100:00100000:3.0:1782239951.388509:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737952512 00000100:00100000:3.0:1782239951.388571:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 13 00000100:00100000:3.0:1782239951.388580:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7ce2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+18:5565:x1868813737952512:12345-192.168.203.32@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1782239951.388957:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7ce2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+19:5565:x1868813737952512:12345-192.168.203.32@tcp:35:ldlm_bl.0 Request processed in 377us (563us total) trans 4294967336 rc 0/0 00000100:00100000:3.0:1782239951.388966:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 13 00000100:00100000:3.0:1782239951.395907:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239951.396091:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737952640 00000100:00100000:1.0:1782239951.396102:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737952640 00010000:00010000:1.0:1782239951.396151:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fa00/0x8c5345f1c1ec50a0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e525 expref: 19 pid: 6611 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239951.396250:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 39 00000100:00100000:1.0:1782239951.396262:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f779ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+19:2344:x1868813737952640:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782239951.396277:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782239951.396285:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fa00/0x8c5345f1c1ec50a0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e525 expref: 19 pid: 6611 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239951.396367:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fa00/0x8c5345f1c1ec50a0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e525 expref: 19 pid: 6611 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239951.396452:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fa00/0x8c5345f1c1ec50a0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e525 expref: 19 pid: 6611 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239951.396469:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bb5c4ed6a00) 00010000:00010000:1.0:1782239951.396475:0:5777:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e600/0x8c5345f1c1ec50ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239951.396484:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e600/0x8c5345f1c1ec50ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239951.396492:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e600/0x8c5345f1c1ec50ca lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239951.396600:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782239951.396669:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f779ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+18:2344:x1868813737952640:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 409us (772us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239951.396677:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 39 00010000:00010000:2.0:1782239951.397214:0:5792:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e600/0x8c5345f1c1ec50ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239951.397225:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e600/0x8c5345f1c1ec50ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782239951.397282:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1782239951.397295:0:5792:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782239951.397334:0:5792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e600/0x8c5345f1c1ec50ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239951.397347:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e600/0x8c5345f1c1ec50ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239951.397356:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fe00/0x8c5345f1c1ec50bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239951.397362:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fe00/0x8c5345f1c1ec50bc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239951.397368:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fe00/0x8c5345f1c1ec50bc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239951.397374:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5ee29fe00 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:2.0:1782239951.397388:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fe00/0x8c5345f1c1ec50bc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239951.397396:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fe00/0x8c5345f1c1ec50bc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239951.397407:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bb5c4ed6b00) 00010000:00010000:2.0:1782239951.397410:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782239951.397414:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fe00/0x8c5345f1c1ec50bc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239951.397420:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fe00/0x8c5345f1c1ec50bc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239951.397442:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e800/0x8c5345f1c1ec50c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239951.397449:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e800/0x8c5345f1c1ec50c3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239951.397455:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e800/0x8c5345f1c1ec50c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239951.397460:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5ee29e800 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:2.0:1782239951.397463:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e800/0x8c5345f1c1ec50c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239951.397469:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e800/0x8c5345f1c1ec50c3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239951.397478:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bb5c4ed6d00) 00010000:00010000:2.0:1782239951.397684:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782239951.397689:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e800/0x8c5345f1c1ec50c3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239951.397695:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e800/0x8c5345f1c1ec50c3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239951.397736:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec50b5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e52c expref: 18 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239951.397830:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e600/0x8c5345f1c1ec50ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e52c expref: 17 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239951.397850:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bb5c4ed6a00) 00010000:00010000:2.0:1782239951.397852:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782239951.397855:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5ee29e600, rc 0) 00000100:00100000:2.0:1782239951.397911:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f779d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+17:10351:x1868813737952256:12345-192.168.203.32@tcp:101:stat.0 Request processed in 23685us (23917us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239951.397919:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 53 00000100:00100000:3.0:1782239951.523154:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239951.523848:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737952896 00000100:00100000:2.0:1782239951.523864:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737952896 00000100:00100000:2.0:1782239951.523952:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 54 00000100:00100000:2.0:1782239951.523964:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f779fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+17:10357:x1868813737952896:12345-192.168.203.32@tcp:36:truncate.0 00010000:00010000:2.0:1782239951.524028:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782239951.524056:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e600/0x8c5345f1c1ec50ca lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e52c expref: 17 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239951.524077:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bb5c4ed6a00) 00010000:00010000:2.0:1782239951.524082:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782239951.524372:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec50d1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239951.524387:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec50d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239951.524398:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec50d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782239951.524452:0:5790:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:2.0:1782239951.524478:0:5790:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001f2e5f15 reply state 00000000339d8733 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec50d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239951.524500:0:5790:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782239951.524939:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f779fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+19:10357:x1868813737952896:12345-192.168.203.32@tcp:36:truncate.0 Request processed in 975us (1802us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1782239951.524948:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 54 00000020:00080000:2.0:1782239951.524953:0:5790:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1782239951.535813:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec50d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239951.535837:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec50d1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239951.535845:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec50d1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239951.536170:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5ee29ea00 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:2.0:1782239951.536178:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec50d1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239951.536189:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec50d1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239951.536211:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bb5c4ed6a00) 00010000:00010000:2.0:1782239951.536215:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782239951.536298:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec50d1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239951.536307:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec50d1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239951.780151:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239951.780301:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737953024 00000100:00100000:0.0:1782239951.780315:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737953024 00000100:00100000:0.0:1782239951.780407:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 55 00000100:00100000:0.0:1782239951.780421:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7ce3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+18:10371:x1868813737953024:12345-192.168.203.32@tcp:101:stat.0 00010000:00010000:0.0:1782239951.780456:0:6611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782239951.780496:0:6611:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030a00/0x8c5345f1c1ec50d8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e533 expref: -99 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239951.780583:0:6611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030e00/0x8c5345f1c1ec50df lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239951.780600:0:6611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030e00/0x8c5345f1c1ec50df lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239951.780614:0:6611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030e00/0x8c5345f1c1ec50df lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239951.780631:0:6611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031e00/0x8c5345f1c1ec50e6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239951.780651:0:6611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031e00/0x8c5345f1c1ec50e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239951.780659:0:6611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031e00/0x8c5345f1c1ec50e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239951.781363:0:6611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030800/0x8c5345f1c1ec50ed lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239951.781617:0:6611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030800/0x8c5345f1c1ec50ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239951.781629:0:6611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030800/0x8c5345f1c1ec50ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782239951.781827:0:6611:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:0.0:1782239951.781832:0:6611:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782239951.781864:0:6611:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030800/0x8c5345f1c1ec50ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239951.781879:0:6611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030800/0x8c5345f1c1ec50ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239951.781890:0:6611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030e00/0x8c5345f1c1ec50df lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239951.781897:0:6611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030e00/0x8c5345f1c1ec50df lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239951.781904:0:6611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030e00/0x8c5345f1c1ec50df lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239951.782040:0:6611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5c0030e00 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:0.0:1782239951.782045:0:6611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030e00/0x8c5345f1c1ec50df lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239951.782054:0:6611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030e00/0x8c5345f1c1ec50df lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239951.782070:0:6611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bb5c4ed6b00) 00010000:00010000:0.0:1782239951.782073:0:6611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782239951.782078:0:6611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030e00/0x8c5345f1c1ec50df lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239951.782084:0:6611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030e00/0x8c5345f1c1ec50df lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239951.782110:0:6611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031e00/0x8c5345f1c1ec50e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239951.782116:0:6611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031e00/0x8c5345f1c1ec50e6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239951.782122:0:6611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031e00/0x8c5345f1c1ec50e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239951.782126:0:6611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5c0031e00 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:0.0:1782239951.782129:0:6611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031e00/0x8c5345f1c1ec50e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239951.782133:0:6611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031e00/0x8c5345f1c1ec50e6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239951.782151:0:6611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bb5c55de800) 00010000:00010000:0.0:1782239951.782153:0:6611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782239951.782155:0:6611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031e00/0x8c5345f1c1ec50e6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239951.782161:0:6611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031e00/0x8c5345f1c1ec50e6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239951.782208:0:6611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030a00/0x8c5345f1c1ec50d8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e533 expref: 20 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239951.782235:0:6611:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030800/0x8c5345f1c1ec50ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e533 expref: 19 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239951.782243:0:6611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bb5c4ed6a00) 00010000:00010000:0.0:1782239951.782245:0:6611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782239951.782247:0:6611:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5c0030800, rc 0) 00000100:00100000:0.0:1782239951.782359:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7ce3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+19:10371:x1868813737953024:12345-192.168.203.32@tcp:101:stat.0 Request processed in 1941us (2222us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239951.782370:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 55 00000100:00100000:0.0:1782239951.887518:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239951.887712:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737953280 00000100:00100000:1.0:1782239951.887727:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737953280 00000100:00100000:1.0:1782239951.887852:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 56 00000100:00100000:1.0:1782239951.887864:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7c0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+19:10381:x1868813737953280:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:1.0:1782239951.887896:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782239951.887927:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38600/0x8c5345f1c1ec50f4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e53a expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782239951.888306:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:1.0:1782239951.888644:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38600/0x8c5345f1c1ec50f4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e53a expref: 21 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239951.888661:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bb5d0df4400) 00010000:00010000:1.0:1782239951.888665:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782239951.888670:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38600/0x8c5345f1c1ec50f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e53a expref: 21 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239951.888685:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5f7e38600, rc 0) 00000100:00100000:1.0:1782239951.888826:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7c0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+20:10381:x1868813737953280:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 964us (1323us total) trans 4294967339 rc 301/301 00000100:00100000:1.0:1782239951.888834:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 56 00000100:00100000:1.0:1782239951.896731:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239951.897485:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737953536 00000100:00100000:3.0:1782239951.897501:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737953536 00000100:00100000:3.0:1782239951.897742:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 14 00000100:00100000:3.0:1782239951.897812:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ded67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+20:10381:x1868813737953536:12345-192.168.203.32@tcp:35:lfs.0 00000100:00100000:3.0:1782239951.898506:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ded67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+21:10381:x1868813737953536:12345-192.168.203.32@tcp:35:lfs.0 Request processed in 698us (1788us total) trans 4294967340 rc 0/0 00000100:00100000:3.0:1782239951.898517:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 14 00000100:00100000:3.0:1782239951.965595:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239951.966022:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737953792 00000100:00100000:2.0:1782239951.966036:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737953792 00000100:00100000:2.0:1782239951.966186:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 57 00000100:00100000:2.0:1782239951.966200:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f779c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+21:10388:x1868813737953792:12345-192.168.203.32@tcp:101:bash.0 00010000:00010000:2.0:1782239951.966240:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782239951.966273:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec5102 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e541 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239951.966417:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e600/0x8c5345f1c1ec5109 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239951.966438:0:5792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030800/0x8c5345f1c1ec50ed lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e533 expref: 22 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239951.966449:0:5792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e600/0x8c5345f1c1ec5109 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239951.966495:0:5792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030800/0x8c5345f1c1ec50ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e533 expref: 22 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239951.966510:0:5792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030800/0x8c5345f1c1ec50ed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e533 expref: 22 pid: 6611 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239951.966527:0:5792:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f7ce0700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5792:1868813758956800:192.168.203.32@tcp:104: 00000100:00100000:2.0:1782239951.966655:0:5792:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5e8c9a840 going to sleep for 11 seconds 00000100:00100000:1.0:1782239951.970652:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239951.970783:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737953920 00000100:00100000:3.0:1782239951.970794:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737953920 00010000:00010000:3.0:1782239951.970848:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030800/0x8c5345f1c1ec50ed lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e533 expref: 23 pid: 6611 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239951.970899:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 40 00000100:00100000:3.0:1782239951.970912:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ded65180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+23:2345:x1868813737953920:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782239951.970933:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782239951.970940:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030800/0x8c5345f1c1ec50ed lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e533 expref: 23 pid: 6611 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239951.970985:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030800/0x8c5345f1c1ec50ed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e533 expref: 23 pid: 6611 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239951.971017:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bb5c4ed6a00) 00010000:00010000:3.0:1782239951.971022:0:5776:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e600/0x8c5345f1c1ec5109 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239951.971034:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e600/0x8c5345f1c1ec5109 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239951.971041:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e600/0x8c5345f1c1ec5109 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239951.971065:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782239951.971146:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ded65180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+23:2345:x1868813737953920:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 236us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239951.971155:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 40 00010000:00010000:2.0:1782239951.971946:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030800/0x8c5345f1c1ec50ed lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e533 expref: 22 pid: 6611 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239951.971981:0:5792:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f7ce0700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5792:1868813758956800:192.168.203.32@tcp:104: 00010000:00010000:2.0:1782239951.972031:0:5792:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e600/0x8c5345f1c1ec5109 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239951.972042:0:5792:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e600/0x8c5345f1c1ec5109 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239951.972048:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e600/0x8c5345f1c1ec5109 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782239951.972075:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:2.0:1782239951.972315:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec5102 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e541 expref: 23 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239951.972334:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e600/0x8c5345f1c1ec5109 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e541 expref: 22 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239951.972344:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bb5c4ed6a00) 00010000:00010000:2.0:1782239951.972347:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1782239951.972351:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5ee29e600, rc 0) 00000100:00100000:2.0:1782239951.973608:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f779c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+22:10388:x1868813737953792:12345-192.168.203.32@tcp:101:bash.0 Request processed in 7401us (8019us total) trans 4294967341 rc 0/0 00000100:00100000:2.0:1782239951.973622:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 57 00000100:00100000:1.0:1782239951.977247:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239951.977346:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737954176 00000100:00100000:3.0:1782239951.977359:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737954176 00000100:00100000:3.0:1782239951.977491:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 58 00000100:00100000:3.0:1782239951.977502:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ded67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+22:10388:x1868813737954176:12345-192.168.203.32@tcp:36:bash.0 00010000:00010000:3.0:1782239951.978852:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44c00/0x8c5345f1c1ec5117 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239951.978881:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44c00/0x8c5345f1c1ec5117 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239951.978894:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44c00/0x8c5345f1c1ec5117 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782239951.979499:0:5790:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:3.0:1782239951.979542:0:5790:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000044ed16c3 reply state 00000000e3eb88a3 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44c00/0x8c5345f1c1ec5117 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239951.979555:0:5790:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782239951.979824:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ded67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+25:10388:x1868813737954176:12345-192.168.203.32@tcp:36:bash.0 Request processed in 2319us (2587us total) trans 4294967343 rc 0/0 00000100:00100000:3.0:1782239951.979835:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 58 00000020:00080000:3.0:1782239951.979843:0:5790:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1782239951.994511:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44c00/0x8c5345f1c1ec5117 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239951.994537:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44c00/0x8c5345f1c1ec5117 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239951.994545:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44c00/0x8c5345f1c1ec5117 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239951.994572:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5c2a44c00 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:0.0:1782239951.994578:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44c00/0x8c5345f1c1ec5117 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239951.994586:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44c00/0x8c5345f1c1ec5117 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239951.994610:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bb5c4ed6a00) 00010000:00010000:0.0:1782239951.994613:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782239951.994619:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44c00/0x8c5345f1c1ec5117 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239951.994625:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44c00/0x8c5345f1c1ec5117 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239952.006309:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239952.009470:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737954304 00000100:00100000:0.0:1782239952.009927:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737954304 00000100:00100000:1.0:1782239952.010357:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 59 00000100:00100000:1.0:1782239952.010549:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ded64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+24:10388:x1868813737954304:12345-192.168.203.32@tcp:101:bash.0 00010000:00010000:1.0:1782239952.010585:0:6611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782239952.010613:0:6611:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39e00/0x8c5345f1c1ec511e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e548 expref: -99 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239952.010725:0:6611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38000/0x8c5345f1c1ec5125 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239952.010744:0:6611:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e600/0x8c5345f1c1ec5109 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e541 expref: 25 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239952.010979:0:6611:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38000/0x8c5345f1c1ec5125 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239952.011060:0:6611:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e600/0x8c5345f1c1ec5109 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e541 expref: 25 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239952.011077:0:6611:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e600/0x8c5345f1c1ec5109 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e541 expref: 25 pid: 5792 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239952.011094:0:6611:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f7e63b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6611:1868813758956928:192.168.203.32@tcp:104: 00000100:00100000:1.0:1782239952.011245:0:6611:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5f7c1c900 going to sleep for 11 seconds 00000100:00100000:1.0:1782239952.020205:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239952.020307:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737954432 00000100:00100000:0.0:1782239952.020319:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737954432 00010000:00010000:0.0:1782239952.020371:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e600/0x8c5345f1c1ec5109 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e541 expref: 26 pid: 5792 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782239952.020428:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 41 00000100:00100000:0.0:1782239952.020441:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7e63100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+26:2345:x1868813737954432:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782239952.020459:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782239952.020467:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e600/0x8c5345f1c1ec5109 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e541 expref: 26 pid: 5792 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239952.020493:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e600/0x8c5345f1c1ec5109 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e541 expref: 26 pid: 5792 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239952.020541:0:5775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bb5c4ed6a00) 00010000:00010000:0.0:1782239952.020548:0:5775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38000/0x8c5345f1c1ec5125 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239952.020563:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38000/0x8c5345f1c1ec5125 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239952.020572:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38000/0x8c5345f1c1ec5125 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239952.020595:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782239952.020682:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7e63100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+26:2345:x1868813737954432:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 243us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239952.020691:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 41 00010000:00010000:3.0:1782239952.023935:0:6611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e600/0x8c5345f1c1ec5109 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e541 expref: 25 pid: 5792 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239952.023975:0:6611:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f7e63b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6611:1868813758956928:192.168.203.32@tcp:104: 00010000:00010000:3.0:1782239952.024006:0:6611:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38000/0x8c5345f1c1ec5125 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239952.024019:0:6611:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38000/0x8c5345f1c1ec5125 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239952.024027:0:6611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38000/0x8c5345f1c1ec5125 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782239952.024096:0:6611:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1782239952.024109:0:6611:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782239952.024135:0:6611:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38000/0x8c5345f1c1ec5125 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239952.024180:0:6611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39e00/0x8c5345f1c1ec511e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e548 expref: 25 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239952.024227:0:6611:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38000/0x8c5345f1c1ec5125 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e548 expref: 24 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239952.024238:0:6611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bb5c4ed6a00) 00010000:00010000:3.0:1782239952.024241:0:6611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782239952.024245:0:6611:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5f7e38000, rc 0) 00000100:00100000:3.0:1782239952.024342:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ded64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+24:10388:x1868813737954304:12345-192.168.203.32@tcp:101:bash.0 Request processed in 13972us (18047us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239952.024352:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 59 00000100:00100000:1.0:1782239952.035400:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239952.035620:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737954688 00000100:00100000:0.0:1782239952.035637:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737954688 00000100:00100000:0.0:1782239952.035721:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 15 00000100:00100000:0.0:1782239952.035734:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5c77e1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+24:10388:x1868813737954688:12345-192.168.203.32@tcp:35:bash.0 00000100:00100000:0.0:1782239952.036129:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5c77e1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+25:10388:x1868813737954688:12345-192.168.203.32@tcp:35:bash.0 Request processed in 396us (752us total) trans 4294967344 rc 0/0 00000100:00100000:0.0:1782239952.036138:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 15 00010000:00010000:3.0:1782239952.097619:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782239952.152697:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239952.152827:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737954944 00000100:00100000:1.0:1782239952.152840:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737954944 00000100:00100000:1.0:1782239952.152916:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 60 00000100:00100000:1.0:1782239952.152937:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7c0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+25:10398:x1868813737954944:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:1.0:1782239952.152973:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782239952.152999:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38800/0x8c5345f1c1ec512c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e54f expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782239952.153368:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:1.0:1782239952.153577:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38800/0x8c5345f1c1ec512c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e54f expref: 27 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239952.153595:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bb5d0df4400) 00010000:00010000:1.0:1782239952.153599:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782239952.153605:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38800/0x8c5345f1c1ec512c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e54f expref: 27 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239952.153622:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5f7e38800, rc 0) 00000100:00100000:1.0:1782239952.153715:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7c0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+26:10398:x1868813737954944:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 779us (1031us total) trans 4294967345 rc 301/301 00000100:00100000:1.0:1782239952.153724:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 60 00000100:00100000:2.0:1782239952.157594:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239952.157687:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737955072 00000100:00100000:1.0:1782239952.157700:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737955072 00000100:00100000:1.0:1782239952.157804:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 61 00000100:00100000:1.0:1782239952.157816:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7ce0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+26:10398:x1868813737955072:12345-192.168.203.32@tcp:34:lfs.0 00010000:00010000:1.0:1782239952.157928:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38400/0x8c5345f1c1ec513a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239952.157973:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38400/0x8c5345f1c1ec513a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239952.157989:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38400/0x8c5345f1c1ec513a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239952.158009:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38e00/0x8c5345f1c1ec5141 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239952.158016:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38e00/0x8c5345f1c1ec5141 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239952.158022:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38e00/0x8c5345f1c1ec5141 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239952.158469:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39c00/0x8c5345f1c1ec5148 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239952.158481:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39c00/0x8c5345f1c1ec5148 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239952.158490:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39c00/0x8c5345f1c1ec5148 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782239952.158549:0:5792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39c00/0x8c5345f1c1ec5148 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239952.158564:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38400/0x8c5345f1c1ec513a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239952.158570:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38400/0x8c5345f1c1ec513a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239952.158588:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38400/0x8c5345f1c1ec513a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239952.158595:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f7e38400 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:1.0:1782239952.158600:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38400/0x8c5345f1c1ec513a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239952.158608:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38400/0x8c5345f1c1ec513a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239952.158623:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bb5c4ed6b00) 00010000:00010000:1.0:1782239952.158625:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782239952.158631:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38400/0x8c5345f1c1ec513a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239952.158637:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38400/0x8c5345f1c1ec513a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239952.158655:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38e00/0x8c5345f1c1ec5141 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239952.158661:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38e00/0x8c5345f1c1ec5141 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239952.158666:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38e00/0x8c5345f1c1ec5141 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239952.158671:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f7e38e00 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:1.0:1782239952.158674:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38e00/0x8c5345f1c1ec5141 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239952.158690:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38e00/0x8c5345f1c1ec5141 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239952.158698:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bb5c30e4b00) 00010000:00010000:1.0:1782239952.158700:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782239952.158703:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38e00/0x8c5345f1c1ec5141 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239952.158709:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38e00/0x8c5345f1c1ec5141 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239952.158725:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39c00/0x8c5345f1c1ec5148 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239952.158731:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39c00/0x8c5345f1c1ec5148 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239952.158736:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39c00/0x8c5345f1c1ec5148 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239952.158741:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f7e39c00 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:1.0:1782239952.158744:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39c00/0x8c5345f1c1ec5148 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239952.158795:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39c00/0x8c5345f1c1ec5148 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239952.158803:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bb5c4ed6a00) 00010000:00010000:1.0:1782239952.158805:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782239952.158808:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39c00/0x8c5345f1c1ec5148 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239952.158824:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39c00/0x8c5345f1c1ec5148 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239952.158938:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7ce0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+26:10398:x1868813737955072:12345-192.168.203.32@tcp:34:lfs.0 Request processed in 1122us (1355us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239952.158949:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 61 00000100:00100000:0.0:1782239952.162510:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239952.162677:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737955328 00000100:00100000:3.0:1782239952.162691:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737955328 00000100:00100000:3.0:1782239952.162805:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 16 00000100:00100000:3.0:1782239952.162817:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7c0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+26:10398:x1868813737955328:12345-192.168.203.32@tcp:35:lfs.0 00000100:00100000:3.0:1782239952.164164:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7c0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+27:10398:x1868813737955328:12345-192.168.203.32@tcp:35:lfs.0 Request processed in 1341us (1661us total) trans 4294967346 rc 0/0 00000100:00100000:3.0:1782239952.164177:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 16 00000100:00100000:0.0:1782239952.205030:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239952.205147:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737955584 00000100:00100000:1.0:1782239952.205161:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737955584 00000100:00100000:1.0:1782239952.205240:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 62 00000100:00100000:1.0:1782239952.205253:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7c0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+27:10401:x1868813737955584:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:1.0:1782239952.205288:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782239952.205323:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39c00/0x8c5345f1c1ec514f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e556 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239952.205445:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38e00/0x8c5345f1c1ec5156 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239952.205463:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38e00/0x8c5345f1c1ec5156 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239952.205476:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38e00/0x8c5345f1c1ec5156 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239952.205494:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38400/0x8c5345f1c1ec515d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239952.205501:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38400/0x8c5345f1c1ec515d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239952.205530:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38400/0x8c5345f1c1ec515d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239952.206157:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38800/0x8c5345f1c1ec5164 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239952.206170:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38800/0x8c5345f1c1ec5164 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239952.206178:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38800/0x8c5345f1c1ec5164 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782239952.206192:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1782239952.206320:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38e00/0x8c5345f1c1ec5156 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239952.206329:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38e00/0x8c5345f1c1ec5156 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239952.206336:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38e00/0x8c5345f1c1ec5156 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239952.206343:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f7e38e00 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:1.0:1782239952.206348:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38e00/0x8c5345f1c1ec5156 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239952.206358:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38e00/0x8c5345f1c1ec5156 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239952.206372:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bb5c4ed6b00) 00010000:00010000:1.0:1782239952.206376:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782239952.206389:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38e00/0x8c5345f1c1ec5156 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239952.206396:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38e00/0x8c5345f1c1ec5156 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239952.206411:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38400/0x8c5345f1c1ec515d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239952.206418:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38400/0x8c5345f1c1ec515d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239952.206424:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38400/0x8c5345f1c1ec515d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239952.206430:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f7e38400 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:1.0:1782239952.206432:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38400/0x8c5345f1c1ec515d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239952.206437:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38400/0x8c5345f1c1ec515d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239952.206445:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bb5c30e4b00) 00010000:00010000:1.0:1782239952.206447:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782239952.206450:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38400/0x8c5345f1c1ec515d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239952.206455:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38400/0x8c5345f1c1ec515d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239952.206508:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39c00/0x8c5345f1c1ec514f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e556 expref: 30 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239952.206536:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38800/0x8c5345f1c1ec5164 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e556 expref: 29 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239952.206543:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bb5c4ed6a00) 00010000:00010000:1.0:1782239952.206545:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782239952.206548:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5f7e38800, rc 0) 00000100:00100000:1.0:1782239952.206640:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7c0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+29:10401:x1868813737955584:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 1389us (1740us total) trans 4294967347 rc 0/0 00000100:00100000:1.0:1782239952.206650:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 62 00000100:00100000:2.0:1782239952.214119:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239952.214176:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239952.214273:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737955712 00000100:00100000:1.0:1782239952.214287:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737955712 00000100:00100000:1.0:1782239952.214391:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 63 00000100:00100000:1.0:1782239952.214407:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7ce2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+29:10401:x1868813737955712:12345-192.168.203.32@tcp:54:lfs.0 00010000:00010000:1.0:1782239952.214531:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39c00/0x8c5345f1c1ec5172 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239952.214570:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39c00/0x8c5345f1c1ec5172 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239952.214588:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39c00/0x8c5345f1c1ec5172 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239952.214633:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39c00/0x8c5345f1c1ec5172 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239952.214642:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39c00/0x8c5345f1c1ec5172 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239952.214676:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39c00/0x8c5345f1c1ec5172 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239952.214683:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f7e39c00 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:1.0:1782239952.214689:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39c00/0x8c5345f1c1ec5172 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239952.214700:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39c00/0x8c5345f1c1ec5172 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239952.214718:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bb5c4ed6a00) 00010000:00010000:1.0:1782239952.214722:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782239952.214730:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39c00/0x8c5345f1c1ec5172 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239952.214737:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39c00/0x8c5345f1c1ec5172 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239952.214906:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7ce2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+29:10401:x1868813737955712:12345-192.168.203.32@tcp:54:lfs.0 Request processed in 502us (812us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239952.214914:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 63 00000100:00100000:3.0:1782239952.215523:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737955840 00000100:00100000:3.0:1782239952.215533:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737955840 00000100:00100000:3.0:1782239952.215604:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 4 00000100:00100000:3.0:1782239952.215613:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7ce0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+29:2346:x1868813737955840:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782239952.215628:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782239952.215651:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38800/0x8c5345f1c1ec5164 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e556 expref: 29 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239952.215687:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bb5c4ed6a00) 00010000:00010000:3.0:1782239952.215691:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782239952.215728:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7ce0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+28:2346:x1868813737955840:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 116us (1550us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239952.215735:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 4 00000100:00100000:1.0:1782239952.221366:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239952.221640:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737956096 00000100:00100000:2.0:1782239952.221654:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737956096 00000100:00100000:2.0:1782239952.221791:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 17 00000100:00100000:2.0:1782239952.221804:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7e62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+28:10401:x1868813737956096:12345-192.168.203.32@tcp:35:lfs.0 00000100:00100000:2.0:1782239952.222182:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7e62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+29:10401:x1868813737956096:12345-192.168.203.32@tcp:35:lfs.0 Request processed in 378us (830us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1782239952.222192:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 17 00000100:00100000:2.0:1782239952.354021:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239952.354153:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737956352 00000100:00100000:1.0:1782239952.354167:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737956352 00000100:00100000:1.0:1782239952.354250:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 64 00000100:00100000:1.0:1782239952.354263:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7ce1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+29:10419:x1868813737956352:12345-192.168.203.32@tcp:101:cat.0 00010000:00010000:1.0:1782239952.354298:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782239952.354336:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39c00/0x8c5345f1c1ec5179 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e55d expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239952.354495:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38e00/0x8c5345f1c1ec5180 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239952.354516:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38e00/0x8c5345f1c1ec5180 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239952.354531:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38e00/0x8c5345f1c1ec5180 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782239952.354544:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1782239952.354729:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39c00/0x8c5345f1c1ec5179 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e55d expref: 32 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239952.354811:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38e00/0x8c5345f1c1ec5180 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e55d expref: 31 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239952.354823:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bb5c4ed6a00) 00010000:00010000:1.0:1782239952.354826:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1782239952.354831:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5f7e38e00, rc 0) 00000100:00100000:1.0:1782239952.355052:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7ce1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+31:10419:x1868813737956352:12345-192.168.203.32@tcp:101:cat.0 Request processed in 791us (1044us total) trans 4294967349 rc 0/0 00000100:00100000:1.0:1782239952.355061:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 64 00000100:00100000:1.0:1782239952.391138:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239952.392008:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737956480 00000100:00100000:0.0:1782239952.392023:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737956480 00000100:00100000:0.0:1782239952.392122:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 65 00000100:00100000:0.0:1782239952.392163:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7e61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+31:10420:x1868813737956480:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:0.0:1782239952.392211:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782239952.392250:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030a00/0x8c5345f1c1ec518e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e564 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239952.392355:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030800/0x8c5345f1c1ec5195 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239952.392383:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030800/0x8c5345f1c1ec5195 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239952.392401:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030800/0x8c5345f1c1ec5195 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782239952.392903:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:0.0:1782239952.392909:0:5792:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1782239952.393000:0:5792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030800/0x8c5345f1c1ec5195 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239952.393039:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030a00/0x8c5345f1c1ec518e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e564 expref: 33 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239952.393060:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030800/0x8c5345f1c1ec5195 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e564 expref: 32 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239952.393069:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bb5c4ed6b00) 00010000:00010000:0.0:1782239952.393072:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782239952.393076:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5c0030800, rc 0) 00000100:00100000:0.0:1782239952.393174:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7e61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+32:10420:x1868813737956480:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 1014us (2050us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239952.393193:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 65 00000100:00100000:2.0:1782239952.404044:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239952.404208:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737956864 00000100:00100000:3.0:1782239952.404230:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737956864 00000100:00100000:3.0:1782239952.404299:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 18 00000100:00100000:3.0:1782239952.404311:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7ce2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+32:10420:x1868813737956864:12345-192.168.203.32@tcp:35:lfs.0 00000100:00100000:3.0:1782239952.405070:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7ce2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+33:10420:x1868813737956864:12345-192.168.203.32@tcp:35:lfs.0 Request processed in 757us (1036us total) trans 4294967350 rc 0/0 00000100:00100000:3.0:1782239952.405081:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 18 00000100:00100000:2.0:1782239952.410654:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239952.410906:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737956992 00000100:00100000:0.0:1782239952.410987:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737956992 00000100:00100000:0.0:1782239952.411133:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 5 00000100:00100000:0.0:1782239952.411145:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7ce3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+33:10420:x1868813737956992:12345-192.168.203.32@tcp:103:lfs.0 00010000:00010000:0.0:1782239952.411165:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1782239952.411199:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38000/0x8c5345f1c1ec5125 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e548 expref: 33 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239952.411238:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38e00/0x8c5345f1c1ec5180 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e55d expref: 32 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239952.411251:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ec00/0x8c5345f1c1ec5029 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e509 expref: 31 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239952.411262:0:5775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bb5c4ed6a00) 00010000:00010000:0.0:1782239952.411280:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782239952.411358:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7ce3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+30:10420:x1868813737956992:12345-192.168.203.32@tcp:103:lfs.0 Request processed in 215us (718us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239952.411368:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 5 00000100:00100000:3.0:1782239952.413861:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239952.414039:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737957120 00000100:00100000:2.0:1782239952.414054:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737957120 00000100:00100000:2.0:1782239952.414147:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 66 00000100:00100000:2.0:1782239952.414160:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f779d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+30:10420:x1868813737957120:12345-192.168.203.32@tcp:58:lfs.0 00010000:00010000:2.0:1782239952.414346:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e600/0x8c5345f1c1ec519c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239952.414367:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e600/0x8c5345f1c1ec519c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239952.414392:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e600/0x8c5345f1c1ec519c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782239952.415622:0:5790:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1782239952.416818:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1782239952.417062:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1782239952.417942:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f779d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+30:10420:x1868813737957120:12345-192.168.203.32@tcp:58:lfs.0 Request processed in 3771us (4085us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239952.417961:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 66 00000100:00100000:2.0:1782239952.442955:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239952.443126:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737957248 00000100:00100000:3.0:1782239952.443141:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737957248 00000100:00100000:3.0:1782239952.443224:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 67 00000100:00100000:3.0:1782239952.443238:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f46fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+30:10422:x1868813737957248:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:3.0:1782239952.443270:0:6611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782239952.443298:0:6611:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44c00/0x8c5345f1c1ec51a3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e56b expref: -99 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239952.443400:0:6611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44200/0x8c5345f1c1ec51aa lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239952.443418:0:6611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44200/0x8c5345f1c1ec51aa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239952.443451:0:6611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44200/0x8c5345f1c1ec51aa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239952.443470:0:6611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec51b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239952.443477:0:6611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec51b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239952.443484:0:6611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec51b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239952.444296:0:6611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044e00/0x8c5345f1c1ec51b8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239952.444313:0:6611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044e00/0x8c5345f1c1ec51b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239952.444323:0:6611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044e00/0x8c5345f1c1ec51b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782239952.444424:0:6611:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1782239952.444429:0:6611:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782239952.444454:0:6611:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044e00/0x8c5345f1c1ec51b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239952.444469:0:6611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044e00/0x8c5345f1c1ec51b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239952.444478:0:6611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44200/0x8c5345f1c1ec51aa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239952.444496:0:6611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44200/0x8c5345f1c1ec51aa lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239952.444504:0:6611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44200/0x8c5345f1c1ec51aa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239952.444511:0:6611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5c2a44200 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:3.0:1782239952.444516:0:6611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44200/0x8c5345f1c1ec51aa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239952.444524:0:6611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44200/0x8c5345f1c1ec51aa lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239952.444538:0:6611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bb5c4ed6b00) 00010000:00010000:3.0:1782239952.444541:0:6611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782239952.444546:0:6611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44200/0x8c5345f1c1ec51aa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239952.444554:0:6611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44200/0x8c5345f1c1ec51aa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239952.444570:0:6611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec51b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239952.444576:0:6611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec51b1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239952.444581:0:6611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec51b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239952.444586:0:6611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5c2a44000 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:3.0:1782239952.444595:0:6611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec51b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239952.444603:0:6611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec51b1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239952.444611:0:6611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bb5d0df4d00) 00010000:00010000:3.0:1782239952.444614:0:6611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782239952.444617:0:6611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec51b1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239952.444624:0:6611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec51b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239952.444668:0:6611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44c00/0x8c5345f1c1ec51a3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e56b expref: 32 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239952.444683:0:6611:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044e00/0x8c5345f1c1ec51b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e56b expref: 31 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239952.445083:0:6611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bb5c4ed6d00) 00010000:00010000:3.0:1782239952.445086:0:6611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782239952.445089:0:6611:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb602044e00, rc 0) 00000100:00100000:3.0:1782239952.445208:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f46fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+31:10422:x1868813737957248:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 1972us (2680us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239952.445218:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 67 00000040:00080000:1.0:1782239952.927653:0:11535:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1782239952.927667:0:11535:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1782239952.927729:0:11535:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1782239952.927738:0:11535:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1782239952.927977:0:11535:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f7e63800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11535:1868813758957056:192.168.203.32@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1782239952.928141:0:11535:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5f7c1c240 going to sleep for 11 seconds 00000100:00100000:0.0:1782239952.942047:0:11535:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f7e63800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11535:1868813758957056:192.168.203.32@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1782239952.945176:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239952.945997:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737957376 00000100:00100000:3.0:1782239952.946012:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737957376 00000100:00100000:3.0:1782239952.946106:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 1 00000100:00100000:3.0:1782239952.946119:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f46fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:36dd742b-25b8-431e-bf41-75f2fff47ffb+31:10433:x1868813737957376:12345-192.168.203.32@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1782239952.946255:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f46fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:36dd742b-25b8-431e-bf41-75f2fff47ffb+31:10433:x1868813737957376:12345-192.168.203.32@tcp:900:lhsmtool_posix.0 Request processed in 138us (1094us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239952.946264:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 1 00000100:00100000:3.0:1782239952.949401:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239952.949513:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737957504 00000100:00100000:0.0:1782239952.949527:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737957504 00000100:00100000:0.0:1782239952.949614:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 68 00000100:00100000:0.0:1782239952.949625:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f779c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+31:10433:x1868813737957504:12345-192.168.203.32@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1782239952.949694:0:5791:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1782239952.949880:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f779c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+31:10433:x1868813737957504:12345-192.168.203.32@tcp:53:lhsmtool_posix.0 Request processed in 256us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239952.949890:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 68 00000100:00100000:2.0:1782239952.953918:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239952.954108:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737957632 00000100:00100000:3.0:1782239952.954121:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737957632 00000100:00100000:3.0:1782239952.954261:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 69 00000100:00100000:3.0:1782239952.954275:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f46fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+31:10433:x1868813737957632:12345-192.168.203.32@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1782239952.954389:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044a00/0x8c5345f1c1ec51bf lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239952.954412:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044a00/0x8c5345f1c1ec51bf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239952.954428:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044a00/0x8c5345f1c1ec51bf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239952.954675:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602045000/0x8c5345f1c1ec51c6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239952.954833:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602045000/0x8c5345f1c1ec51c6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239952.954848:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602045000/0x8c5345f1c1ec51c6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239952.954891:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44c00/0x8c5345f1c1ec51cd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239952.954901:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44c00/0x8c5345f1c1ec51cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239952.954923:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44c00/0x8c5345f1c1ec51cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782239952.954973:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1782239952.954978:0:5792:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782239952.954991:0:5792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44c00/0x8c5345f1c1ec51cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239952.955003:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044a00/0x8c5345f1c1ec51bf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239952.955009:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044a00/0x8c5345f1c1ec51bf lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239952.955016:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044a00/0x8c5345f1c1ec51bf lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239952.955022:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb602044a00 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:3.0:1782239952.955026:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044a00/0x8c5345f1c1ec51bf lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239952.955033:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044a00/0x8c5345f1c1ec51bf lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239952.955047:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bb5d0df4b00) 00010000:00010000:3.0:1782239952.955050:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782239952.955055:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044a00/0x8c5345f1c1ec51bf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239952.955061:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044a00/0x8c5345f1c1ec51bf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239952.955091:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602045000/0x8c5345f1c1ec51c6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239952.955113:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602045000/0x8c5345f1c1ec51c6 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239952.955119:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602045000/0x8c5345f1c1ec51c6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239952.955126:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb602045000 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:3.0:1782239952.955129:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602045000/0x8c5345f1c1ec51c6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239952.955135:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602045000/0x8c5345f1c1ec51c6 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239952.955142:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff9bb5d0df4d00) 00010000:00010000:3.0:1782239952.955144:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782239952.955147:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602045000/0x8c5345f1c1ec51c6 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239952.955151:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602045000/0x8c5345f1c1ec51c6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239952.955168:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44c00/0x8c5345f1c1ec51cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239952.955174:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44c00/0x8c5345f1c1ec51cd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239952.955180:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44c00/0x8c5345f1c1ec51cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239952.955192:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5c2a44c00 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:3.0:1782239952.955195:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44c00/0x8c5345f1c1ec51cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239952.955200:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44c00/0x8c5345f1c1ec51cd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239952.955207:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bb5c4ed6d00) 00010000:00010000:3.0:1782239952.955209:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782239952.955212:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44c00/0x8c5345f1c1ec51cd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239952.955217:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44c00/0x8c5345f1c1ec51cd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239952.956805:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f46fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+31:10433:x1868813737957632:12345-192.168.203.32@tcp:34:lhsmtool_posix.0 Request processed in 2525us (2897us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239952.956821:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 69 00000100:00100000:2.0:1782239952.968776:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239952.969466:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737957888 00000100:00100000:0.0:1782239952.969485:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737957888 00000100:00100000:0.0:1782239952.969562:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 70 00000100:00100000:0.0:1782239952.969575:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+31:10433:x1868813737957888:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782239952.969600:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782239952.969630:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030e00/0x8c5345f1c1ec51d4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e572 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239952.969740:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031e00/0x8c5345f1c1ec51db lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239952.969788:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031e00/0x8c5345f1c1ec51db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239952.969802:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031e00/0x8c5345f1c1ec51db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782239952.969814:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1782239952.969940:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031e00/0x8c5345f1c1ec51db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239952.969948:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031e00/0x8c5345f1c1ec51db lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239952.969956:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031e00/0x8c5345f1c1ec51db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239952.969977:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5c0031e00 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:0.0:1782239952.969981:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031e00/0x8c5345f1c1ec51db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239952.969990:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031e00/0x8c5345f1c1ec51db lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239952.970003:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bb5c4ed6d00) 00010000:00010000:0.0:1782239952.970006:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782239952.970010:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031e00/0x8c5345f1c1ec51db lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239952.970017:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031e00/0x8c5345f1c1ec51db lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239952.970068:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030e00/0x8c5345f1c1ec51d4 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e572 expref: 33 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239952.970079:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bb5d0df4b00) 00010000:00010000:0.0:1782239952.970081:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782239952.970085:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030e00/0x8c5345f1c1ec51d4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e572 expref: 33 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239952.970109:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5c0030e00, rc 0) 00000100:00100000:0.0:1782239952.970180:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+32:10433:x1868813737957888:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 607us (1433us total) trans 4294967351 rc 301/301 00000100:00100000:0.0:1782239952.970189:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 70 00000100:00100000:3.0:1782239952.973898:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239952.973996:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737958016 00000100:00100000:0.0:1782239952.974025:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737958016 00000100:00100000:0.0:1782239952.974105:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 71 00000100:00100000:0.0:1782239952.974117:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f779f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+32:10433:x1868813737958016:12345-192.168.203.32@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1782239952.974174:0:6611:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1782239952.974292:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f779f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+32:10433:x1868813737958016:12345-192.168.203.32@tcp:53:lhsmtool_posix.0 Request processed in 176us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239952.974300:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 71 00000100:00100000:2.0:1782239952.985079:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239952.985176:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737958272 00000100:00100000:0.0:1782239952.985195:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737958272 00000100:00100000:0.0:1782239952.985290:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 72 00000100:00100000:0.0:1782239952.985303:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+32:10433:x1868813737958272:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782239952.985329:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782239952.985332:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1782239952.985362:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030800/0x8c5345f1c1ec5195 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e564 expref: 32 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239952.985383:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bb5c4ed6b00) 00010000:00010000:0.0:1782239952.985388:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782239952.985402:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030a00/0x8c5345f1c1ec51e9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e579 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782239952.986181:0:5790:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:0.0:1782239952.986435:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602172a00/0x8c5345f1c1ec51f0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239952.986450:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602172a00/0x8c5345f1c1ec51f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239952.986471:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602172a00/0x8c5345f1c1ec51f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239952.986532:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030a00/0x8c5345f1c1ec51e9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e579 expref: 34 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239952.986549:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602172a00/0x8c5345f1c1ec51f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e579 expref: 33 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239952.986557:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9bb5c55de800) 00010000:00010000:0.0:1782239952.986560:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782239952.986563:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb602172a00, rc 0) 00000100:00100000:0.0:1782239952.986649:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+33:10433:x1868813737958272:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 1348us (1587us total) trans 4294967352 rc 0/0 00000100:00100000:0.0:1782239952.986659:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 72 00000100:00100000:0.0:1782239952.989580:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239952.991236:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737958528 00000100:00100000:3.0:1782239952.991260:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737958528 00000100:00100000:3.0:1782239952.991373:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 73 00000100:00100000:3.0:1782239952.991386:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7c0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+33:10433:x1868813737958528:12345-192.168.203.32@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1782239952.991881:0:6611:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782239952.991932:0:6611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602172a00/0x8c5345f1c1ec51f0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e579 expref: 33 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239952.991965:0:6611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9bb5c55de800) 00010000:00010000:3.0:1782239952.991998:0:6611:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782239952.992041:0:6611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44c00/0x8c5345f1c1ec51fe lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239952.992059:0:6611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44c00/0x8c5345f1c1ec51fe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239952.992071:0:6611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44c00/0x8c5345f1c1ec51fe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239952.992092:0:6611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec5205 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x5d5a84b9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239952.992113:0:6611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec5205 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x5d5a84b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239952.992986:0:6611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec5205 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x5d5a84b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239952.993392:0:6611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44c00/0x8c5345f1c1ec51fe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239952.993402:0:6611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44c00/0x8c5345f1c1ec51fe lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239952.993410:0:6611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44c00/0x8c5345f1c1ec51fe lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239952.993418:0:6611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5c2a44c00 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:3.0:1782239952.993424:0:6611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44c00/0x8c5345f1c1ec51fe lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239952.993432:0:6611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44c00/0x8c5345f1c1ec51fe lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239952.993455:0:6611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bb5c4ed6b00) 00010000:00010000:3.0:1782239952.993458:0:6611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782239952.998244:0:6611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44c00/0x8c5345f1c1ec51fe lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239952.998277:0:6611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44c00/0x8c5345f1c1ec51fe lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239952.998305:0:6611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec5205 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x5d5a84b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239952.998314:0:6611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec5205 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x5d5a84b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239952.998322:0:6611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec5205 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x5d5a84b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239952.998329:0:6611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5c2a44000 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:3.0:1782239952.998335:0:6611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec5205 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x5d5a84b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239952.998344:0:6611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec5205 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x5d5a84b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239952.998378:0:6611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x5d5a84b9 (ffff9bb5d0df4d00) 00010000:00010000:3.0:1782239952.998382:0:6611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782239952.998389:0:6611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec5205 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x5d5a84b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239952.998396:0:6611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec5205 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x5d5a84b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239952.998947:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7c0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+32:10433:x1868813737958528:12345-192.168.203.32@tcp:36:lhsmtool_posix.0 Request processed in 7552us (9367us total) trans 0 rc -2/-2 00000100:00100000:3.0:1782239952.998959:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 73 00000100:00100000:3.0:1782239953.002813:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239953.003239:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737958656 00000100:00100000:1.0:1782239953.003253:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737958656 00000100:00100000:1.0:1782239953.003333:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 74 00000100:00100000:1.0:1782239953.003345:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f779d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+32:10433:x1868813737958656:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782239953.003372:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782239953.003402:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39600/0x8c5345f1c1ec520c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e580 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239953.003447:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38c00/0x8c5345f1c1ec5213 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239953.003475:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38c00/0x8c5345f1c1ec5213 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239953.003489:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38c00/0x8c5345f1c1ec5213 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239953.003632:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39600/0x8c5345f1c1ec520c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e580 expref: 34 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239953.005342:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38c00/0x8c5345f1c1ec5213 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e580 expref: 33 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239953.005357:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9bb5c30e4b00) 00010000:00010000:1.0:1782239953.005360:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1782239953.005363:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5f7e38c00, rc 0) 00000100:00100000:1.0:1782239953.005475:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f779d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+33:10433:x1868813737958656:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 2121us (2664us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239953.005516:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 74 00000100:00080000:1.0:1782239953.005572:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782239953.017922:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239953.021182:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737958912 00000100:00100000:1.0:1782239953.021206:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737958912 00000100:00100000:1.0:1782239953.021303:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 75 00000100:00100000:1.0:1782239953.021317:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f779e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+33:10433:x1868813737958912:12345-192.168.203.32@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1782239953.021441:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39800/0x8c5345f1c1ec521a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239953.021465:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39800/0x8c5345f1c1ec521a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239953.021491:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39800/0x8c5345f1c1ec521a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782239953.022211:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:1.0:1782239953.022228:0:5792:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 332094478429ns, next at 333094474987ns, rc = 0 00000004:00010000:1.0:1782239953.022357:0:5792:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a27a5928 reply state 000000002f6753ea transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39800/0x8c5345f1c1ec521a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239953.022370:0:5792:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782239953.028434:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f779e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+35:10433:x1868813737958912:12345-192.168.203.32@tcp:36:lhsmtool_posix.0 Request processed in 7100us (10507us total) trans 4294967353 rc 0/0 00000100:00100000:0.0:1782239953.028453:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 75 00010000:00010000:1.0:1782239953.033340:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39800/0x8c5345f1c1ec521a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239953.033376:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39800/0x8c5345f1c1ec521a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239953.033385:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39800/0x8c5345f1c1ec521a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239953.033410:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f7e39800 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:1.0:1782239953.033415:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39800/0x8c5345f1c1ec521a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239953.033425:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39800/0x8c5345f1c1ec521a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239953.033447:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9bb5c30e4b00) 00010000:00010000:1.0:1782239953.033451:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1782239953.033457:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39800/0x8c5345f1c1ec521a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239953.033463:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39800/0x8c5345f1c1ec521a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239953.035205:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239953.035284:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737959040 00000100:00100000:1.0:1782239953.035298:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737959040 00000100:00100000:1.0:1782239953.035380:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 76 00000100:00100000:1.0:1782239953.035392:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f779c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+34:10433:x1868813737959040:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782239953.035423:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782239953.035451:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39600/0x8c5345f1c1ec5221 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e587 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239953.035544:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39600/0x8c5345f1c1ec5221 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e587 expref: 35 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239953.035561:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39600/0x8c5345f1c1ec5221 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e587 expref: 35 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239953.035606:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9bb5c30e4b00) 00010000:00010000:1.0:1782239953.035609:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782239953.035613:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5f7e39600, rc 0) 00000100:00100000:1.0:1782239953.035690:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f779c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+35:10433:x1868813737959040:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 300us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239953.035698:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 76 00000100:00100000:0.0:1782239953.045871:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239953.048566:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737959168 00000100:00100000:3.0:1782239953.048585:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737959168 00000100:00100000:3.0:1782239953.048655:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 25 00000100:00100000:3.0:1782239953.048666:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7c0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2343:x1868813737959168:12345-192.168.203.32@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1782239953.048712:0:6588:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 36dd742b-25b8-431e-bf41-75f2fff47ffb@192.168.203.32@tcp t0 exp 0000000000000000 cur 332 last 0 00000020:00000080:3.0:1782239953.048763:0:6588:0:(genops.c:1406:class_connect()) connect: client 36dd742b-25b8-431e-bf41-75f2fff47ffb, cookie 0x8c5345f1c1ec5228 00002000:00100000:3.0:1782239953.048778:0:6588:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 36dd742b-25b8-431e-bf41-75f2fff47ffb/ffff9bb5c319a800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1782239953.048807:0:6588:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1782239953.049085:0:6588:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1782239953.049142:0:6588:0:(import.c:65:import_set_state_nolock()) ffff9bb5c319a000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782239953.049247:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7c0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+6:2343:x1868813737959168:12345-192.168.203.32@tcp:8:lhsmtool_posix.0 Request processed in 579us (3390us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239953.049256:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 25 00000100:00100000:3.0:1782239953.054025:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239953.054143:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737959296 00000100:00100000:0.0:1782239953.054157:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737959296 00000100:00100000:0.0:1782239953.054247:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 26 00000100:00100000:0.0:1782239953.054263:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fff03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+6:0:x1868813737959296:12345-192.168.203.32@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1782239953.055197:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1782239953.119950:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1782239953.160033:0:6614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00100000:1.0:1782239953.160058:0:6614:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 36dd742b-25b8-431e-bf41-75f2fff47ffb 00000100:00100000:0.0:1782239953.160301:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fff03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+5:0:x1868813737959296:12345-192.168.203.32@tcp:2:lhsmtool_posix.0 Request processed in 106033us (106284us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1782239953.160325:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 26 00000100:00100000:1.0:1782239953.169355:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239953.170349:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737959552 00000100:00100000:3.0:1782239953.170374:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737959552 00000100:00100000:3.0:1782239953.170459:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 19 00000100:00100000:3.0:1782239953.170470:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7e60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+35:10433:x1868813737959552:12345-192.168.203.32@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1782239953.170814:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7e60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+36:10433:x1868813737959552:12345-192.168.203.32@tcp:35:lhsmtool_posix.0 Request processed in 345us (1477us total) trans 4294967354 rc 0/0 00000100:00100000:3.0:1782239953.170823:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 19 00000100:00100000:1.0:1782239953.179246:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239953.179318:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737959808 00000100:00100000:0.0:1782239953.179333:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737959808 00000100:00100000:0.0:1782239953.179418:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 77 00000100:00100000:0.0:1782239953.179430:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7e61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+36:10433:x1868813737959808:12345-192.168.203.32@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1782239953.179590:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7e61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+36:10433:x1868813737959808:12345-192.168.203.32@tcp:57:lhsmtool_posix.0 Request processed in 161us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239953.179598:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 77 00000100:00100000:0.0:1782239953.186071:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f48eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813758957184:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782239953.186190:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239953.186220:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758957184 00000100:00100000:3.0:1782239953.186231:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758957184 00000100:00100000:3.0:1782239953.186295:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1782239953.186305:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7c0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1868813758957184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782239953.186334:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782239953.186389:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7c0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1868813758957184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239953.186397:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1782239953.186452:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f48eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813758957184:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1782239953.186521:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782239953.187797:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239953.189602:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737959936 00000100:00100000:1.0:1782239953.189620:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737959936 00000100:00100000:1.0:1782239953.189704:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 78 00000100:00100000:1.0:1782239953.189716:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+36:10433:x1868813737959936:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782239953.189762:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782239953.189793:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39000/0x8c5345f1c1ec522f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e58e expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239953.189882:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39800/0x8c5345f1c1ec5236 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239953.189900:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39800/0x8c5345f1c1ec5236 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239953.189913:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39800/0x8c5345f1c1ec5236 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782239953.189972:0:5790:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782239953.189994:0:5790:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39800/0x8c5345f1c1ec5236 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239953.190026:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39000/0x8c5345f1c1ec522f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e58e expref: 38 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239953.190047:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39800/0x8c5345f1c1ec5236 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e58e expref: 37 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239953.190058:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9bb5c30e4b00) 00010000:00010000:1.0:1782239953.190061:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1782239953.190065:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5f7e39800, rc 0) 00000100:00100000:1.0:1782239953.190163:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+37:10433:x1868813737959936:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 448us (2378us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239953.190171:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 78 00000100:00100000:2.0:1782239953.197672:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239953.197847:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737960064 00000100:00100000:3.0:1782239953.197860:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737960064 00000100:00100000:3.0:1782239953.197929:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 27 00000100:00100000:3.0:1782239953.197940:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+5:2345:x1868813737960064:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782239953.197965:0:6588:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782239953.197998:0:6588:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000094bc7ff1/0x8c5345f1c1ec523d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e595 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782239953.198034:0:6588:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a3ad2d1, blocks: 0x1 00010000:00010000:3.0:1782239953.198060:0:6588:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=332s v=(0 0) 00010000:00010000:3.0:1782239953.198065:0:6588:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782239953.198091:0:6588:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094bc7ff1/0x8c5345f1c1ec523d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e595 expref: 6 pid: 6588 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239953.198144:0:6588:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000094bc7ff1/0x8c5345f1c1ec523d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e595 expref: 6 pid: 6588 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239953.198160:0:6588:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5c2a44000, rc 0) 00000100:00100000:3.0:1782239953.198236:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+6:2345:x1868813737960064:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 297us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239953.198244:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 27 00000100:00100000:3.0:1782239953.202381:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239953.202473:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737960320 00000100:00100000:0.0:1782239953.202494:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737960320 00000100:00100000:0.0:1782239953.202581:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 79 00000100:00100000:0.0:1782239953.202594:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc08dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+37:10433:x1868813737960320:12345-192.168.203.32@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1782239953.202774:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc08dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+37:10433:x1868813737960320:12345-192.168.203.32@tcp:57:lhsmtool_posix.0 Request processed in 183us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239953.202784:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 79 00000100:00100000:2.0:1782239953.207783:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239953.209659:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737960448 00000100:00100000:3.0:1782239953.209676:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737960448 00000100:00100000:3.0:1782239953.209776:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 28 00000100:00100000:3.0:1782239953.209789:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+6:10433:x1868813737960448:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782239953.209814:0:6589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782239953.209838:0:6589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e5de555c/0x8c5345f1c1ec5244 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e59c expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239953.209882:0:6589:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000094bc7ff1/0x8c5345f1c1ec523d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e595 expref: 7 pid: 6588 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239953.209892:0:6589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782239953.209897:0:6589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782239953.209903:0:6589:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e5de555c/0x8c5345f1c1ec5244 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e59c expref: 7 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239953.209946:0:6589:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000094bc7ff1/0x8c5345f1c1ec523d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e595 expref: 7 pid: 6588 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239953.209978:0:6589:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000094bc7ff1/0x8c5345f1c1ec523d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e595 expref: 7 pid: 6588 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239953.209996:0:6589:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fc08f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6589:1868813758957312:192.168.203.32@tcp:104: 00000100:00100000:3.0:1782239953.210147:0:6589:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5d1bb39c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782239953.219398:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239953.219518:0:6589:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fc08f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6589:1868813758957312:192.168.203.32@tcp:104: 00010000:00010000:3.0:1782239953.219564:0:6589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e5de555c/0x8c5345f1c1ec5244 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e59c expref: 7 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239953.219592:0:6589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5c2a44c00, rc 0) 00000100:00100000:3.0:1782239953.219673:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+7:10433:x1868813737960448:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 9885us (11933us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239953.219684:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 28 00000100:00100000:0.0:1782239953.221879:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737960576 00000100:00100000:0.0:1782239953.221901:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737960576 00010000:00010000:0.0:1782239953.221970:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000094bc7ff1/0x8c5345f1c1ec523d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e595 expref: 7 pid: 6588 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782239953.222033:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 42 00000100:00100000:0.0:1782239953.222044:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d021bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+7:2345:x1868813737960576:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782239953.222085:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782239953.222136:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000094bc7ff1/0x8c5345f1c1ec523d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e595 expref: 7 pid: 6588 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239953.222152:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000094bc7ff1/0x8c5345f1c1ec523d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e595 expref: 7 pid: 6588 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239953.222184:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000094bc7ff1/0x8c5345f1c1ec523d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e595 expref: 7 pid: 6588 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239953.222209:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782239953.222214:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782239953.222223:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e5de555c/0x8c5345f1c1ec5244 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e59c expref: 6 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239953.222235:0:5776:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e5de555c/0x8c5345f1c1ec5244 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e59c expref: 6 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239953.222292:0:5776:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000e5de555c/0x8c5345f1c1ec5244 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e59c expref: 6 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782239953.222315:0:5776:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f7c0ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5776:1868813758957440:192.168.203.32@tcp:105: 00000100:00100000:0.0:1782239953.222436:0:5776:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c886cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1782239953.230650:0:5776:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f7c0ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5776:1868813758957440:192.168.203.32@tcp:105: 00010000:00010000:0.0:1782239953.230691:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782239953.230798:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d021bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+6:2345:x1868813737960576:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 8754us (11413us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239953.230813:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 42 00000100:00100000:0.0:1782239953.239554:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239953.240371:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737960704 00000100:00100000:3.0:1782239953.240387:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737960704 00002000:00100000:3.0:1782239953.240452:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9bb5f7c0ce00 x1868813737960704/t0(0) o4->36dd742b-25b8-431e-bf41-75f2fff47ffb@192.168.203.32@tcp:554/0 lens 504/0 e 0 to 0 dl 1782239964 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1782239953.240465:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9bb5f7c0ce00 with x1868813737960704 ext(0->8) 00002000:00010000:3.0:1782239953.240471:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bb5f7c0ce00 00000100:00100000:3.0:1782239953.240511:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 0 00000100:00100000:3.0:1782239953.240522:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7c0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+6:2344:x1868813737960704:12345-192.168.203.32@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1782239953.241654:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7c0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+8:2344:x1868813737960704:12345-192.168.203.32@tcp:4:lhsmtool_posix.0 Request processed in 1125us (2108us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1782239953.241674:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 0 00002000:00100000:3.0:1782239953.241684:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9bb5f7c0ce00 x1868813737960704/t4294967302(0) o4->36dd742b-25b8-431e-bf41-75f2fff47ffb@192.168.203.32@tcp:554/0 lens 504/448 e 0 to 0 dl 1782239964 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1782239953.241694:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9bb5f7c0ce00 with x1868813737960704 ext(0->8) 00002000:00010000:3.0:1782239953.241699:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bb5f7c0ce00 00000100:00100000:0.0:1782239953.246399:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239953.246593:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737960832 00000100:00100000:3.0:1782239953.246602:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737960832 00000100:00100000:3.0:1782239953.246665:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 80 00000100:00100000:3.0:1782239953.246676:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7c0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+37:10433:x1868813737960832:12345-192.168.203.32@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1782239953.354711:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7c0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+37:10433:x1868813737960832:12345-192.168.203.32@tcp:44:lhsmtool_posix.0 Request processed in 108023us (108308us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239953.354730:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 80 00000001:00080000:2.0:1782239953.355040:0:5812:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967352 is committed 00000001:00080000:2.0:1782239953.355078:0:5812:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967353 is committed 00000004:00080000:2.0:1782239953.355085:0:5812:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:2.0:1782239953.355131:0:5812:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000001:00080000:2.0:1782239953.355171:0:5812:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000100:00100000:2.0:1782239953.355360:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f48ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1868813758957568:0@lo:2:osp-syn-0-0.0 00000020:00080000:1.0:1782239953.355800:0:5823:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:1.0:1782239953.355817:0:5823:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1782239953.356859:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239953.358228:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758957568 00000100:00100000:3.0:1782239953.358244:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758957568 00000100:00100000:3.0:1782239953.358432:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1782239953.358446:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1868813758957568:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1782239953.358718:0:6588:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1782239953.358722:0:6588:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1782239953 00002000:00010000:3.0:1782239953.358725:0:6588:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1782239953.358728:0:6588:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1782239953 -> 1782239953 00002000:00010000:3.0:1782239953.358731:0:6588:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1782239953.358955:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1868813758957568:12345-0@lo:2:osp-syn-0-0.0 Request processed in 512us (2101us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1782239953.358965:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:1.0:1782239953.359105:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bb5f48ee300/2, rc 0, transno 4294967303 00000100:00100000:1.0:1782239953.359115:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f48ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1868813758957568:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1782239953.361111:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239953.361835:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737960960 00000100:00100000:2.0:1782239953.361849:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737960960 00000100:00100000:2.0:1782239953.361930:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 30 00000100:00100000:2.0:1782239953.361943:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7e62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+8:2344:x1868813737960960:12345-192.168.203.32@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1782239953.473001:0:6614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:2.0:1782239953.473024:0:6614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:2.0:1782239953.473195:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7e62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+6:2344:x1868813737960960:12345-192.168.203.32@tcp:16:lhsmtool_posix.0 Request processed in 111244us (112096us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239953.473210:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 30 00000100:00100000:1.0:1782239953.481690:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239953.485454:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737961216 00000100:00100000:1.0:1782239953.486724:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737961216 00000100:00100000:1.0:1782239953.487037:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 81 00000100:00100000:1.0:1782239953.487049:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7e61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+13:10433:x1868813737961216:12345-192.168.203.32@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1782239953.487152:0:6611:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782239953.487197:0:6611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39800/0x8c5345f1c1ec5236 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e58e expref: 13 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239953.487222:0:6611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9bb5c30e4b00) 00010000:00010000:1.0:1782239953.487229:0:6611:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782239953.487276:0:6611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38a00/0x8c5345f1c1ec524b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239953.487294:0:6611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38a00/0x8c5345f1c1ec524b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239953.487305:0:6611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38a00/0x8c5345f1c1ec524b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782239953.489245:0:6611:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000019b672f4 reply state 00000000e693d5b2 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38a00/0x8c5345f1c1ec524b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239953.489270:0:6611:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782239953.489459:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7e61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+14:10433:x1868813737961216:12345-192.168.203.32@tcp:36:lhsmtool_posix.0 Request processed in 2406us (7778us total) trans 4294967355 rc 0/0 00000100:00100000:1.0:1782239953.493560:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 81 00010000:00010000:1.0:1782239953.506972:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38a00/0x8c5345f1c1ec524b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239953.506998:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38a00/0x8c5345f1c1ec524b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239953.507008:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38a00/0x8c5345f1c1ec524b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239953.507030:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f7e38a00 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:1.0:1782239953.507036:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38a00/0x8c5345f1c1ec524b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239953.507046:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38a00/0x8c5345f1c1ec524b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239953.507070:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9bb5c30e4b00) 00010000:00010000:1.0:1782239953.507073:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782239953.507080:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38a00/0x8c5345f1c1ec524b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239953.507087:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38a00/0x8c5345f1c1ec524b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782239953.507527:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239953.513609:0:8312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737961344 00000100:00100000:1.0:1782239953.513631:0:8312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737961344 00000100:00100000:1.0:1782239953.513723:0:8312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 31 00000100:00100000:1.0:1782239953.513736:0:8312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7c0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+6:2344:x1868813737961344:12345-192.168.203.32@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1782239953.515723:0:8312:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1782239953.515734:0:8312:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1782239953 -> 1782239952 00002000:00010000:1.0:1782239953.515738:0:8312:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1782239950 00002000:00010000:1.0:1782239953.515740:0:8312:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1782239953 -> 1782239952 00002000:00010000:1.0:1782239953.515743:0:8312:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1782239953.515870:0:8312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7c0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+7:2344:x1868813737961344:12345-192.168.203.32@tcp:2:lhsmtool_posix.0 Request processed in 2130us (8343us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1782239953.515882:0:8312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 31 00000100:00100000:1.0:1782239953.523286:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239953.523405:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737961600 00000100:00100000:0.0:1782239953.523419:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737961600 00000100:00100000:0.0:1782239953.523508:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 82 00000100:00100000:0.0:1782239953.523520:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7e61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+13:10433:x1868813737961600:12345-192.168.203.32@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1782239953.523614:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602173800/0x8c5345f1c1ec5252 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239953.523636:0:5791:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38c00/0x8c5345f1c1ec5213 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e580 expref: 13 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239953.523647:0:5791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602173800/0x8c5345f1c1ec5252 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239953.523693:0:5791:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38c00/0x8c5345f1c1ec5213 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e580 expref: 13 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239953.523710:0:5791:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38c00/0x8c5345f1c1ec5213 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e580 expref: 13 pid: 5790 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782239953.523727:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f7c0e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5791:1868813758957696:192.168.203.32@tcp:104: 00000100:00100000:0.0:1782239953.523928:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c886ce40 going to sleep for 11 seconds 00000100:00100000:1.0:1782239953.527305:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f7c0e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5791:1868813758957696:192.168.203.32@tcp:104: 00010000:00010000:1.0:1782239953.527349:0:5791:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602173800/0x8c5345f1c1ec5252 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239953.528351:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239953.528470:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737961728 00000100:00100000:0.0:1782239953.528508:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737961728 00010000:00010000:0.0:1782239953.528573:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38c00/0x8c5345f1c1ec5213 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e580 expref: 14 pid: 5790 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782239953.528610:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 43 00000100:00100000:0.0:1782239953.528621:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7e63480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+14:2344:x1868813737961728:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782239953.528641:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782239953.528648:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38c00/0x8c5345f1c1ec5213 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e580 expref: 14 pid: 5790 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239953.528663:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38c00/0x8c5345f1c1ec5213 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e580 expref: 14 pid: 5790 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239953.528693:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38c00/0x8c5345f1c1ec5213 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e580 expref: 14 pid: 5790 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239953.528713:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9bb5c30e4b00) 00010000:00010000:0.0:1782239953.528719:0:5777:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602173800/0x8c5345f1c1ec5252 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239953.528729:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602173800/0x8c5345f1c1ec5252 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239953.528737:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602173800/0x8c5345f1c1ec5252 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239953.528795:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782239953.528862:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7e63480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+13:2344:x1868813737961728:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 242us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239953.528879:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 43 00010000:00010000:3.0:1782239953.529147:0:5791:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602173800/0x8c5345f1c1ec5252 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239953.529165:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602173800/0x8c5345f1c1ec5252 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239953.529211:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602173800/0x8c5345f1c1ec5252 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239953.529219:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602173800/0x8c5345f1c1ec5252 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239953.529226:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602173800/0x8c5345f1c1ec5252 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239953.529233:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb602173800 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:3.0:1782239953.529238:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602173800/0x8c5345f1c1ec5252 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239953.529246:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602173800/0x8c5345f1c1ec5252 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239953.529256:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9bb5c30e4b00) 00010000:00010000:3.0:1782239953.529259:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1782239953.529263:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602173800/0x8c5345f1c1ec5252 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239953.529270:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602173800/0x8c5345f1c1ec5252 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239953.529334:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7e61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+12:10433:x1868813737961600:12345-192.168.203.32@tcp:55:lhsmtool_posix.0 Request processed in 5817us (6065us total) trans 0 rc -22/-22 00000100:00100000:3.0:1782239953.529343:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 82 00000100:00100000:1.0:1782239953.535543:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239953.535712:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737961856 00000100:00100000:3.0:1782239953.535727:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737961856 00000100:00100000:3.0:1782239953.535828:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 32 00000100:00100000:3.0:1782239953.535839:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7e62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+7:2345:x1868813737961856:12345-192.168.203.32@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1782239953.535900:0:6589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000094bc7ff1/0x8c5345f1c1ec5259 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239953.535927:0:6589:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e5de555c/0x8c5345f1c1ec5244 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e59c expref: 7 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239953.535937:0:6589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782239953.535941:0:6589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782239953.535947:0:6589:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094bc7ff1/0x8c5345f1c1ec5259 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239953.535992:0:6589:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e5de555c/0x8c5345f1c1ec5244 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e59c expref: 7 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239953.536008:0:6589:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e5de555c/0x8c5345f1c1ec5244 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e59c expref: 7 pid: 6589 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239953.536027:0:6589:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fc08f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6589:1868813758957824:192.168.203.32@tcp:104: 00000100:00100000:3.0:1782239953.536653:0:6589:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5d0dde000 going to sleep for 11 seconds 00000100:00100000:1.0:1782239953.550337:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239953.550389:0:7481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737961984 00000100:00100000:1.0:1782239953.550401:0:7481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737961984 00010000:00010000:1.0:1782239953.550456:0:7481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e5de555c/0x8c5345f1c1ec5244 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e59c expref: 8 pid: 6589 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239953.550517:0:7481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 44 00000100:00100000:1.0:1782239953.550529:0:7481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7e60380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+8:2345:x1868813737961984:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782239953.550557:0:7481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782239953.550585:0:7481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e5de555c/0x8c5345f1c1ec5244 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e59c expref: 8 pid: 6589 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239953.550601:0:7481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e5de555c/0x8c5345f1c1ec5244 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e59c expref: 8 pid: 6589 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239953.550637:0:7481:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782239953.550641:0:7481:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782239953.550649:0:7481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000094bc7ff1/0x8c5345f1c1ec5259 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239953.550660:0:7481:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094bc7ff1/0x8c5345f1c1ec5259 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239953.550696:0:7481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782239953.550789:0:7481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7e60380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+8:2345:x1868813737961984:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 261us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239953.550798:0:7481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 44 00010000:00010000:3.0:1782239953.554348:0:6589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e5de555c/0x8c5345f1c1ec5244 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e59c expref: 7 pid: 6589 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239953.554394:0:6589:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fc08f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6589:1868813758957824:192.168.203.32@tcp:104: 00010000:00010000:3.0:1782239953.554455:0:6589:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000094bc7ff1/0x8c5345f1c1ec5259 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239953.554488:0:6589:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000094bc7ff1/0x8c5345f1c1ec5259 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239953.554497:0:6589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000094bc7ff1/0x8c5345f1c1ec5259 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239953.554560:0:6589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000094bc7ff1/0x8c5345f1c1ec5259 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239953.554570:0:6589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000094bc7ff1/0x8c5345f1c1ec5259 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239953.554580:0:6589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000094bc7ff1/0x8c5345f1c1ec5259 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239953.554588:0:6589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5c2a44000 already unused, calling callback (ffffffffc1728ce0) 00010000:00010000:3.0:1782239953.554593:0:6589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000094bc7ff1/0x8c5345f1c1ec5259 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239953.554603:0:6589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000094bc7ff1/0x8c5345f1c1ec5259 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239953.554628:0:6589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000094bc7ff1/0x8c5345f1c1ec5259 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239953.554643:0:6589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000094bc7ff1/0x8c5345f1c1ec5259 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239953.554795:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7e62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+6:2345:x1868813737961856:12345-192.168.203.32@tcp:1:lhsmtool_posix.0 Request processed in 18956us (19262us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239953.554806:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 32 00000100:00100000:0.0:1782239953.560189:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239953.560246:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737962240 00000100:00100000:0.0:1782239953.560258:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737962240 00000100:00100000:0.0:1782239953.560335:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 83 00000100:00100000:0.0:1782239953.560348:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7c0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+12:10433:x1868813737962240:12345-192.168.203.32@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1782239953.560454:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602172c00/0x8c5345f1c1ec5260 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239953.561586:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602172c00/0x8c5345f1c1ec5260 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239953.561606:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602172c00/0x8c5345f1c1ec5260 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239953.561933:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602173200/0x8c5345f1c1ec5267 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239953.561950:0:5792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39600/0x8c5345f1c1ec5221 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e587 expref: 13 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239953.562742:0:5792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602173200/0x8c5345f1c1ec5267 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239953.571176:0:5792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39600/0x8c5345f1c1ec5221 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e587 expref: 13 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239953.571207:0:5792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39600/0x8c5345f1c1ec5221 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e587 expref: 13 pid: 5790 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239953.571228:0:5792:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fc08f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5792:1868813758957952:192.168.203.32@tcp:104: 00000100:00100000:3.0:1782239953.571370:0:5792:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5d0dde000 going to sleep for 11 seconds 00000100:00100000:0.0:1782239953.574932:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239953.575032:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737962368 00000100:00100000:2.0:1782239953.575046:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737962368 00010000:00010000:2.0:1782239953.575118:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39600/0x8c5345f1c1ec5221 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e587 expref: 14 pid: 5790 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239953.575194:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 45 00000100:00100000:2.0:1782239953.575206:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7c0f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+14:2347:x1868813737962368:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782239953.575228:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782239953.575236:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39600/0x8c5345f1c1ec5221 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e587 expref: 14 pid: 5790 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239953.575250:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39600/0x8c5345f1c1ec5221 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e587 expref: 14 pid: 5790 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239953.575280:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9bb5c30e4b00) 00010000:00010000:2.0:1782239953.575286:0:5777:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602173200/0x8c5345f1c1ec5267 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239953.575297:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602173200/0x8c5345f1c1ec5267 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239953.575305:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602173200/0x8c5345f1c1ec5267 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239953.575330:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782239953.575399:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7c0f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+14:2347:x1868813737962368:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 194us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239953.575409:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 45 00010000:00010000:3.0:1782239953.575744:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39600/0x8c5345f1c1ec5221 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e587 expref: 13 pid: 5790 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239953.575801:0:5792:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fc08f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5792:1868813758957952:192.168.203.32@tcp:104: 00010000:00010000:3.0:1782239953.575828:0:5792:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602173200/0x8c5345f1c1ec5267 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239953.575839:0:5792:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602173200/0x8c5345f1c1ec5267 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239953.575845:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602173200/0x8c5345f1c1ec5267 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782239953.576102:0:5792:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:3.0:1782239953.576267:0:5792:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:3.0:1782239953.576313:0:5792:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:3.0:1782239953.576410:0:5792:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fc08f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5792:1868813758958080:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1782239953.581276:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239953.581564:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758958080 00000100:00100000:2.0:1782239953.581577:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758958080 00000100:00100000:2.0:1782239953.581657:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782239953.581671:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc08c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5792:x1868813758958080:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1782239953.581842:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc08c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5792:x1868813758958080:12345-0@lo:1000:mdt00_002.0 Request processed in 174us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239953.581851:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782239953.582445:0:5792:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5f7b473c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782239953.582659:0:5792:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:1.0:1782239953.582667:0:5792:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bb5f48ee300, transno 4294967303 00000100:00100000:1.0:1782239953.582737:0:5792:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fc08f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5792:1868813758958080:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1782239953.583600:0:5792:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:1.0:1782239953.583713:0:5792:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f7e60a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5792:1868813758958208:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1782239953.583815:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239953.583852:0:5792:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5f7cbd3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782239953.584062:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758958208 00000100:00100000:3.0:1782239953.584071:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758958208 00000100:00100000:3.0:1782239953.584130:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1782239953.584140:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7e60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5792:x1868813758958208:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1782239953.584391:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7e60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5792:x1868813758958208:12345-0@lo:1000:mdt00_002.0 Request processed in 252us (575us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1782239953.584400:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782239953.584654:0:5792:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f7e60a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5792:1868813758958208:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1782239953.584707:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602173200/0x8c5345f1c1ec5267 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239953.584718:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602173200/0x8c5345f1c1ec5267 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239953.584727:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602173200/0x8c5345f1c1ec5267 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239953.584734:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb602173200 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:1.0:1782239953.584739:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602173200/0x8c5345f1c1ec5267 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239953.584782:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602173200/0x8c5345f1c1ec5267 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239953.584816:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9bb5c30e4b00) 00010000:00010000:1.0:1782239953.584820:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782239953.584826:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602173200/0x8c5345f1c1ec5267 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239953.584833:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602173200/0x8c5345f1c1ec5267 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239953.584880:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e600/0x8c5345f1c1ec519c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239953.584888:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e600/0x8c5345f1c1ec519c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239953.584893:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e600/0x8c5345f1c1ec519c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239953.584899:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5ee29e600 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:1.0:1782239953.584902:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e600/0x8c5345f1c1ec519c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239953.584907:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e600/0x8c5345f1c1ec519c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239953.584916:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bb5c4ed6d00) 00010000:00010000:1.0:1782239953.584918:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782239953.584921:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e600/0x8c5345f1c1ec519c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239953.584927:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e600/0x8c5345f1c1ec519c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239953.584991:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38e00/0x8c5345f1c1ec526e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239953.585010:0:5792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044e00/0x8c5345f1c1ec51b8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e56b expref: 16 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239953.585020:0:5792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38e00/0x8c5345f1c1ec526e lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239953.585053:0:5792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044e00/0x8c5345f1c1ec51b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e56b expref: 16 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239953.585070:0:5792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044e00/0x8c5345f1c1ec51b8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e56b expref: 16 pid: 6611 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239953.585086:0:5792:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f7e62300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5792:1868813758958336:192.168.203.32@tcp:104: 00000100:00100000:1.0:1782239953.585199:0:5792:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5f7cbdf00 going to sleep for 11 seconds 00000100:00100000:2.0:1782239953.596973:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239953.597805:0:5792:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f7e62300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5792:1868813758958336:192.168.203.32@tcp:104: 00010000:00010000:3.0:1782239953.597843:0:5792:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38e00/0x8c5345f1c1ec526e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239953.598273:0:7481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737962496 00000100:00100000:1.0:1782239953.598284:0:7481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737962496 00010000:00010000:1.0:1782239953.598334:0:7481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044e00/0x8c5345f1c1ec51b8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e56b expref: 17 pid: 6611 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239953.598469:0:7481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 46 00000100:00100000:1.0:1782239953.598643:0:7481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+17:2345:x1868813737962496:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782239953.598665:0:7481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782239953.598672:0:7481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044e00/0x8c5345f1c1ec51b8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e56b expref: 17 pid: 6611 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239953.598709:0:7481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044e00/0x8c5345f1c1ec51b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e56b expref: 17 pid: 6611 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239953.598737:0:7481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044e00/0x8c5345f1c1ec51b8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e56b expref: 17 pid: 6611 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239953.598803:0:7481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bb5c4ed6d00) 00010000:00010000:1.0:1782239953.598809:0:7481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38e00/0x8c5345f1c1ec526e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239953.598820:0:7481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38e00/0x8c5345f1c1ec526e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239953.598829:0:7481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38e00/0x8c5345f1c1ec526e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239953.598857:0:7481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782239953.599014:0:5792:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38e00/0x8c5345f1c1ec526e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239953.599023:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38e00/0x8c5345f1c1ec526e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239953.599038:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38e00/0x8c5345f1c1ec526e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239953.599045:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38e00/0x8c5345f1c1ec526e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239953.599064:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38e00/0x8c5345f1c1ec526e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239953.599070:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f7e38e00 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:3.0:1782239953.599076:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38e00/0x8c5345f1c1ec526e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239953.599083:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38e00/0x8c5345f1c1ec526e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239953.599105:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bb5c4ed6d00) 00010000:00010000:3.0:1782239953.599109:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782239953.599113:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38e00/0x8c5345f1c1ec526e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239953.599120:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38e00/0x8c5345f1c1ec526e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239953.599132:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602172c00/0x8c5345f1c1ec5260 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239953.599140:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602172c00/0x8c5345f1c1ec5260 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239953.599145:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602172c00/0x8c5345f1c1ec5260 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239953.599150:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb602172c00 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:3.0:1782239953.599153:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602172c00/0x8c5345f1c1ec5260 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239953.599168:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602172c00/0x8c5345f1c1ec5260 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239953.599178:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bb5c4ed6d00) 00010000:00010000:3.0:1782239953.599180:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1782239953.599184:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602172c00/0x8c5345f1c1ec5260 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239953.599189:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602172c00/0x8c5345f1c1ec5260 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239953.599497:0:7481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+16:2345:x1868813737962496:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 1015us (2537us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239953.599508:0:7481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 46 00000040:00080000:0.0:1782239953.599914:0:11535:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1782239953.599921:0:11535:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1782239953.599952:0:11535:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1782239953.599959:0:11535:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1782239953.602526:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7c0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+15:10433:x1868813737962240:12345-192.168.203.32@tcp:57:lhsmtool_posix.0 Request processed in 42162us (42333us total) trans 4294967360 rc 0/0 00000100:00100000:3.0:1782239953.602545:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 83 00000020:00080000:3.0:1782239953.602556:0:5792:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1782239953.612933:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239953.613163:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737962752 00000100:00100000:3.0:1782239953.613179:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737962752 00000100:00100000:3.0:1782239953.613298:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 20 00000100:00100000:3.0:1782239953.613311:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7c0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+15:10433:x1868813737962752:12345-192.168.203.32@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1782239953.616881:0:5793:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1782239953.617109:0:5793:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:3.0:1782239953.617206:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec5275 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239953.617228:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec5275 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239953.617243:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec5275 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239953.617267:0:5793:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec5275 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239953.617275:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec5275 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239953.617281:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec5275 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239953.617318:0:5793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782239953.617903:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782239953.617913:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec5275 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239953.617922:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5c2a44000 already unused, calling callback (ffffffffc1728ce0) 00010000:00010000:1.0:1782239953.617927:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec5275 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239953.617936:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec5275 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239953.617962:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9bb5d0df4d00) 00010000:00010000:1.0:1782239953.617965:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1782239953.617971:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec5275 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239953.617978:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec5275 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239953.617999:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782239953.618001:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782239953.618003:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782239953.619674:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7c0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+17:10433:x1868813737962752:12345-192.168.203.32@tcp:35:lhsmtool_posix.0 Request processed in 4172us (4564us total) trans 4294967362 rc 0/0 00000100:00100000:3.0:1782239953.619693:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 20 00000020:00080000:3.0:1782239953.619703:0:5793:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:3.0:1782239953.724899:0:11852:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782239953.725070:0:11852:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1782239953.725157:0:11852:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1782239953.725169:0:11852:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1782239953.946349:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239953.946409:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239953.946443:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239953.946490:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239953.946538:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737963264 00000100:00100000:0.0:1782239953.946552:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737963264 00000100:00100000:0.0:1782239953.946627:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 77 00000100:00100000:0.0:1782239953.946641:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f4533450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+7:2344:x1868813737963264:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:0.0:1782239953.946733:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f4533450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+7:2344:x1868813737963264:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 95us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239953.946742:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 77 00000100:00100000:0.0:1782239953.946976:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737963136 00000100:00100000:0.0:1782239953.946981:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737963136 00000100:00100000:0.0:1782239953.947009:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 288 00000100:00100000:0.0:1782239953.947016:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d1bac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afaefb1a-536b-42a3-a3ff-47200f8611c3+13:2344:x1868813737963136:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:0.0:1782239953.947042:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d1bac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afaefb1a-536b-42a3-a3ff-47200f8611c3+13:2344:x1868813737963136:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 26us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239953.947049:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 288 00000100:00100000:0.0:1782239953.947073:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737963008 00000100:00100000:0.0:1782239953.947077:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737963008 00000100:00100000:0.0:1782239953.947115:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737963392 00000100:00100000:2.0:1782239953.947671:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 84 00000100:00100000:2.0:1782239953.947687:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7c0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+17:10443:x1868813737963008:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:2.0:1782239953.947711:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782239953.947743:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec527c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e5a3 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239953.948136:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ec00/0x8c5345f1c1ec5283 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239953.948154:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ec00/0x8c5345f1c1ec5283 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239953.948169:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ec00/0x8c5345f1c1ec5283 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782239953.948183:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:2.0:1782239953.948400:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec527c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e5a3 expref: 20 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239953.948427:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ec00/0x8c5345f1c1ec5283 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e5a3 expref: 19 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239953.948438:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bb5c4ed6b00) 00010000:00010000:2.0:1782239953.948442:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1782239953.948455:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5ee29ec00, rc 0) 00000100:00100000:2.0:1782239953.948656:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7c0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+19:10443:x1868813737963008:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 972us (2319us total) trans 4294967363 rc 0/0 00000100:00100000:2.0:1782239953.948668:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 84 00000100:00080000:1.0:1782239953.949139:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782239953.949589:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737963392 00000100:00100000:0.0:1782239953.949690:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 142 00000100:00100000:0.0:1782239953.949700:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7c0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f135cc01-3d42-4f2a-80ff-79724f1d3285+5:2344:x1868813737963392:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:0.0:1782239953.949795:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7c0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f135cc01-3d42-4f2a-80ff-79724f1d3285+5:2344:x1868813737963392:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 96us (3303us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239953.949815:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 142 00000100:00080000:1.0:1782239953.950520:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782239953.961790:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239953.962281:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737963520 00000100:00100000:3.0:1782239953.962295:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737963520 00000100:00100000:3.0:1782239953.962368:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 85 00000100:00100000:3.0:1782239953.962379:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7c0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+19:10443:x1868813737963520:12345-192.168.203.32@tcp:34:lfs.0 00010000:00010000:3.0:1782239953.962554:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44c00/0x8c5345f1c1ec5291 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239953.962579:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44c00/0x8c5345f1c1ec5291 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239953.962594:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44c00/0x8c5345f1c1ec5291 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239953.962623:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44200/0x8c5345f1c1ec5298 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239953.962632:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44200/0x8c5345f1c1ec5298 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239953.962640:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44200/0x8c5345f1c1ec5298 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239953.963042:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec529f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239953.963051:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec529f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239953.963058:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec529f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782239953.963608:0:5790:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec529f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239953.963627:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44c00/0x8c5345f1c1ec5291 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239953.963633:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44c00/0x8c5345f1c1ec5291 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239953.963641:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44c00/0x8c5345f1c1ec5291 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239953.963648:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5c2a44c00 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:3.0:1782239953.963653:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44c00/0x8c5345f1c1ec5291 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239953.963671:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44c00/0x8c5345f1c1ec5291 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239953.963687:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bb5c4ed6b00) 00010000:00010000:3.0:1782239953.963690:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782239953.963697:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44c00/0x8c5345f1c1ec5291 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239953.963703:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44c00/0x8c5345f1c1ec5291 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239953.963718:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44200/0x8c5345f1c1ec5298 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239953.963724:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44200/0x8c5345f1c1ec5298 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239953.963730:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44200/0x8c5345f1c1ec5298 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239953.963734:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5c2a44200 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:3.0:1782239953.963737:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44200/0x8c5345f1c1ec5298 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239953.963742:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44200/0x8c5345f1c1ec5298 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239953.963783:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bb5d0df4c00) 00010000:00010000:3.0:1782239953.963786:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782239953.963788:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44200/0x8c5345f1c1ec5298 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239953.963805:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44200/0x8c5345f1c1ec5298 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239953.963825:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec529f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239953.963831:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec529f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239953.963837:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec529f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239953.963841:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5c2a44000 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:3.0:1782239953.963845:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec529f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239953.963851:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec529f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239953.963859:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bb5d0df4100) 00010000:00010000:3.0:1782239953.963861:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782239953.963864:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec529f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239953.963870:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec529f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239953.963981:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7c0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+19:10443:x1868813737963520:12345-192.168.203.32@tcp:34:lfs.0 Request processed in 1600us (2232us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239953.963993:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 85 00000100:00100000:0.0:1782239954.050709:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239954.050789:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737963776 00000100:00100000:0.0:1782239954.050801:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737963776 00000100:00100000:0.0:1782239954.050873:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 86 00000100:00100000:0.0:1782239954.050884:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7c0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+19:10446:x1868813737963776:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:0.0:1782239954.050911:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782239954.050937:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602172a00/0x8c5345f1c1ec52a6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e5aa expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239954.051033:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602173600/0x8c5345f1c1ec52ad lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239954.051052:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602173600/0x8c5345f1c1ec52ad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239954.051064:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602173600/0x8c5345f1c1ec52ad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239954.051081:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602172c00/0x8c5345f1c1ec52b4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239954.051101:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602172c00/0x8c5345f1c1ec52b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239954.051322:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602172c00/0x8c5345f1c1ec52b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239954.051817:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602173800/0x8c5345f1c1ec52bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239954.051835:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602173800/0x8c5345f1c1ec52bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239954.051843:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602173800/0x8c5345f1c1ec52bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782239954.051857:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1782239954.051981:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602173600/0x8c5345f1c1ec52ad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239954.051990:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602173600/0x8c5345f1c1ec52ad lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239954.051997:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602173600/0x8c5345f1c1ec52ad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239954.052004:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb602173600 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:0.0:1782239954.052009:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602173600/0x8c5345f1c1ec52ad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239954.052017:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602173600/0x8c5345f1c1ec52ad lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239954.052032:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bb5c4ed6b00) 00010000:00010000:0.0:1782239954.052035:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782239954.052040:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602173600/0x8c5345f1c1ec52ad lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239954.052046:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602173600/0x8c5345f1c1ec52ad lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239954.052058:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602172c00/0x8c5345f1c1ec52b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239954.052069:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602172c00/0x8c5345f1c1ec52b4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239954.052074:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602172c00/0x8c5345f1c1ec52b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239954.052080:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb602172c00 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:0.0:1782239954.052083:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602172c00/0x8c5345f1c1ec52b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239954.052099:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602172c00/0x8c5345f1c1ec52b4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239954.054520:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bb5c55dea00) 00010000:00010000:0.0:1782239954.054534:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782239954.054543:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602172c00/0x8c5345f1c1ec52b4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239954.054555:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602172c00/0x8c5345f1c1ec52b4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239954.054661:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602172a00/0x8c5345f1c1ec52a6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e5aa expref: 22 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239954.054678:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602173800/0x8c5345f1c1ec52bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e5aa expref: 21 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239954.054687:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bb5c55deb00) 00010000:00010000:0.0:1782239954.054690:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782239954.054704:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb602173800, rc 0) 00000100:00100000:0.0:1782239954.055114:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7c0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+21:10446:x1868813737963776:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 4228us (4417us total) trans 4294967364 rc 0/0 00000100:00100000:0.0:1782239954.055125:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 86 00000100:00100000:0.0:1782239954.071870:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239954.072913:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737963904 00000100:00100000:1.0:1782239954.072931:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737963904 00000100:00100000:1.0:1782239954.073166:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 87 00000100:00100000:1.0:1782239954.073180:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f780c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+21:10446:x1868813737963904:12345-192.168.203.32@tcp:54:lfs.0 00010000:00010000:1.0:1782239954.073283:0:6611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38200/0x8c5345f1c1ec52c9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239954.073305:0:6611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38200/0x8c5345f1c1ec52c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239954.073319:0:6611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38200/0x8c5345f1c1ec52c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239954.073356:0:6611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38200/0x8c5345f1c1ec52c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239954.073363:0:6611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38200/0x8c5345f1c1ec52c9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239954.073382:0:6611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38200/0x8c5345f1c1ec52c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239954.073389:0:6611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f7e38200 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:1.0:1782239954.073394:0:6611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38200/0x8c5345f1c1ec52c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239954.073402:0:6611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38200/0x8c5345f1c1ec52c9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239954.073416:0:6611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bb5c55deb00) 00010000:00010000:1.0:1782239954.073420:0:6611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782239954.073425:0:6611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38200/0x8c5345f1c1ec52c9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239954.073431:0:6611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38200/0x8c5345f1c1ec52c9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239954.074076:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f780c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+21:10446:x1868813737963904:12345-192.168.203.32@tcp:54:lfs.0 Request processed in 894us (2220us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239954.074096:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 87 00000100:00100000:0.0:1782239954.090413:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239954.090531:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737964160 00000100:00100000:2.0:1782239954.090545:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737964160 00000100:00100000:2.0:1782239954.090625:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 21 00000100:00100000:2.0:1782239954.090637:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5c77e1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+21:10446:x1868813737964160:12345-192.168.203.32@tcp:35:lfs.0 00000100:00100000:2.0:1782239954.090969:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5c77e1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+22:10446:x1868813737964160:12345-192.168.203.32@tcp:35:lfs.0 Request processed in 333us (568us total) trans 4294967365 rc 0/0 00000100:00100000:2.0:1782239954.090979:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 21 00000100:00100000:1.0:1782239954.128278:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239954.128780:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737964416 00000100:00100000:2.0:1782239954.128796:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737964416 00000100:00100000:2.0:1782239954.128891:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 88 00000100:00100000:2.0:1782239954.128907:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7e61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+22:9974:x1868813737964416:12345-192.168.203.32@tcp:101:bash.0 00010000:00010000:2.0:1782239954.128945:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782239954.128976:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec52d0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e5b1 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239954.129125:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e800/0x8c5345f1c1ec52d7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239954.129142:0:5792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602173800/0x8c5345f1c1ec52bb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e5aa expref: 23 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239954.129153:0:5792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e800/0x8c5345f1c1ec52d7 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239954.129219:0:5792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602173800/0x8c5345f1c1ec52bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e5aa expref: 23 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239954.129235:0:5792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602173800/0x8c5345f1c1ec52bb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e5aa expref: 23 pid: 5791 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239954.129251:0:5792:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f48ec000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5792:1868813758958464:192.168.203.32@tcp:104: 00000100:00100000:2.0:1782239954.129394:0:5792:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c2ed2780 going to sleep for 11 seconds 00000100:00100000:1.0:1782239954.133572:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239954.134104:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737964544 00000100:00100000:0.0:1782239954.134119:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737964544 00010000:00010000:0.0:1782239954.134192:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602173800/0x8c5345f1c1ec52bb lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e5aa expref: 24 pid: 5791 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782239954.134263:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 47 00000100:00100000:0.0:1782239954.134274:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7e60e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+24:2345:x1868813737964544:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782239954.134294:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782239954.134303:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602173800/0x8c5345f1c1ec52bb lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e5aa expref: 24 pid: 5791 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239954.134322:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602173800/0x8c5345f1c1ec52bb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e5aa expref: 24 pid: 5791 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239954.134353:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bb5c55deb00) 00010000:00010000:0.0:1782239954.134361:0:5777:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e800/0x8c5345f1c1ec52d7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239954.134366:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602173800/0x8c5345f1c1ec52bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e5aa expref: 24 pid: 5791 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239954.134374:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e800/0x8c5345f1c1ec52d7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239954.134385:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e800/0x8c5345f1c1ec52d7 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239954.134395:0:5792:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f48ec000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5792:1868813758958464:192.168.203.32@tcp:104: 00010000:00010000:2.0:1782239954.134430:0:5792:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e800/0x8c5345f1c1ec52d7 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239954.134443:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782239954.134445:0:5792:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e800/0x8c5345f1c1ec52d7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239954.134454:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e800/0x8c5345f1c1ec52d7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782239954.134488:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1782239954.135065:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec52d0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e5b1 expref: 25 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239954.135099:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e800/0x8c5345f1c1ec52d7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e5b1 expref: 24 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239954.135122:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bb5c55deb00) 00010000:00010000:2.0:1782239954.135125:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1782239954.135128:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5ee29e800, rc 0) 00000100:00100000:2.0:1782239954.135215:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7e61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+24:9974:x1868813737964416:12345-192.168.203.32@tcp:101:bash.0 Request processed in 6313us (6950us total) trans 4294967366 rc 0/0 00000100:00100000:2.0:1782239954.135226:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 88 00000100:00100000:0.0:1782239954.135781:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7e60e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+23:2345:x1868813737964544:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 1505us (2220us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239954.135792:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 47 00000100:00100000:1.0:1782239954.139956:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239954.140143:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737964800 00000100:00100000:3.0:1782239954.140158:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737964800 00000100:00100000:3.0:1782239954.140244:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 89 00000100:00100000:3.0:1782239954.140256:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7e62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+23:9974:x1868813737964800:12345-192.168.203.32@tcp:36:bash.0 00010000:00010000:3.0:1782239954.141160:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec52e5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239954.141188:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec52e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239954.141204:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec52e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782239954.141275:0:5790:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:3.0:1782239954.142038:0:5790:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006d5ebbae reply state 00000000bdf802fc transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec52e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239954.142055:0:5790:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1782239954.142164:0:5790:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:3.0:1782239954.142580:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7e62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+27:9974:x1868813737964800:12345-192.168.203.32@tcp:36:bash.0 Request processed in 2321us (2633us total) trans 4294967369 rc 0/0 00000100:00100000:3.0:1782239954.142592:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 89 00000020:00080000:3.0:1782239954.142600:0:5790:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:2.0:1782239954.142865:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782239954.145339:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239954.145433:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737964928 00000100:00100000:0.0:1782239954.145447:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737964928 00000100:00100000:0.0:1782239954.145564:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 90 00000100:00100000:0.0:1782239954.145577:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+27:9974:x1868813737964928:12345-192.168.203.32@tcp:101:bash.0 00010000:00010000:0.0:1782239954.145611:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782239954.145640:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602172c00/0x8c5345f1c1ec52ec lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e5b8 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239954.145728:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602172c00/0x8c5345f1c1ec52ec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e5b8 expref: 28 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239954.145785:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602172c00/0x8c5345f1c1ec52ec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e5b8 expref: 28 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239954.145812:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bb5c55deb00) 00010000:00010000:0.0:1782239954.145815:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782239954.145819:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb602172c00, rc 0) 00000100:00100000:0.0:1782239954.145891:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+28:9974:x1868813737964928:12345-192.168.203.32@tcp:101:bash.0 Request processed in 316us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239954.145899:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 90 00000100:00100000:3.0:1782239954.148699:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239954.148914:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737965056 00000100:00100000:0.0:1782239954.148925:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737965056 00000100:00100000:0.0:1782239954.149011:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 33 00000100:00100000:0.0:1782239954.149023:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc08d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+6:9974:x1868813737965056:12345-192.168.203.32@tcp:101:bash.0 00010000:00010000:0.0:1782239954.149048:0:6590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782239954.149078:0:6590:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003cf745fe/0x8c5345f1c1ec52f3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e5bf expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782239954.149121:0:6590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a3ad2d0, atime: 0x6a3ad2ce, ctime: 0x6a3ad2d0, blocks: 0xb 00010000:00010000:0.0:1782239954.149148:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=333s v=(0 0) 00010000:00010000:0.0:1782239954.149153:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782239954.149164:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003cf745fe/0x8c5345f1c1ec52f3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e5bf expref: 7 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239954.149184:0:6590:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003cf745fe/0x8c5345f1c1ec52f3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e5bf expref: 7 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239954.149198:0:6590:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb602173600, rc 0) 00000100:00100000:0.0:1782239954.149268:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc08d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+7:9974:x1868813737965056:12345-192.168.203.32@tcp:101:bash.0 Request processed in 246us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239954.149276:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 33 00010000:00010000:1.0:1782239954.151492:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec52e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239954.151516:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec52e5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239954.151551:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec52e5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239954.151558:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5c2a44000 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:1.0:1782239954.151564:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec52e5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239954.151573:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec52e5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239954.151596:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bb5c55deb00) 00010000:00010000:1.0:1782239954.151600:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782239954.151606:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec52e5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239954.151613:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec52e5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239954.152708:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239954.152937:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737965184 00000100:00100000:2.0:1782239954.152950:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737965184 00002000:00010000:2.0:1782239954.153004:0:6594:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:2.0:1782239954.153011:0:6594:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9bb5fc08ed80 with x1868813737965184 ext(0->18446744073709551615) 00002000:00010000:2.0:1782239954.153025:0:6594:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bb5fc08ed80. 00000100:00100000:2.0:1782239954.153061:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 1 00000100:00100000:2.0:1782239954.153072:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc08ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+7:2344:x1868813737965184:12345-192.168.203.32@tcp:10:bash.0 00002000:00010000:2.0:1782239954.153561:0:6594:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1782239954.153567:0:6594:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1782239952 -> 1782239954 00002000:00010000:2.0:1782239954.153570:0:6594:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1782239950 -> 1782239950 00002000:00010000:2.0:1782239954.153572:0:6594:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1782239952 -> 1782239954 00002000:00010000:2.0:1782239954.153575:0:6594:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1782239954.153720:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc08ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+8:2344:x1868813737965184:12345-192.168.203.32@tcp:10:bash.0 Request processed in 647us (1018us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1782239954.153730:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 1 00002000:00010000:2.0:1782239954.153735:0:6594:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:2.0:1782239954.153738:0:6594:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9bb5fc08ed80 with x1868813737965184 ext(0->18446744073709551615) 00002000:00010000:2.0:1782239954.153810:0:6594:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bb5fc08ed80. 00000100:00100000:0.0:1782239954.210010:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f7e0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1868813758958976:0@lo:400:kworker.0 00000100:00100000:0.0:1782239954.210121:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239954.210212:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782239954.210218:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f7e0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1868813758958848:0@lo:400:kworker.0 00000100:00100000:0.0:1782239954.210252:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239954.210288:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758958976 00000100:00100000:0.0:1782239954.210296:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758958976 00000100:00100000:1.0:1782239954.210390:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f7e0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1868813758958720:0@lo:400:kworker.0 00000100:00100000:1.0:1782239954.210424:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239954.210445:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb60135ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813758959232:0@lo:400:kworker.0 00000100:00100000:1.0:1782239954.210478:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239954.210503:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1782239954.210509:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f780ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3305:1868813758958592:0@lo:400:kworker.0 00000100:00100000:1.0:1782239954.210554:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239954.210575:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f7e0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1868813758959104:0@lo:400:kworker.0 00000100:00100000:1.0:1782239954.210596:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239954.210625:0:8312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758959232 00000100:00100000:1.0:1782239954.210660:0:8312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758959232 00000100:00100000:1.0:1782239954.210735:0:8312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1782239954.210774:0:8312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7e62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3305:x1868813758959232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782239954.210840:0:8312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7e62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3305:x1868813758959232:12345-0@lo:400:kworker.0 Request processed in 95us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239954.210848:0:8312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:1.0:1782239954.210874:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782239954.210911:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb60135ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813758959232:0@lo:400:kworker.0 00000100:00100000:1.0:1782239954.210963:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758958848 00000100:00100000:1.0:1782239954.210967:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758958848 00000100:00100000:1.0:1782239954.210999:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758958720 00000100:00100000:1.0:1782239954.211002:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758958720 00000100:00100000:1.0:1782239954.211014:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758959104 00000100:00100000:1.0:1782239954.211016:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758959104 00000100:00100000:1.0:1782239954.211033:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1782239954.211038:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5eddf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1868813758958848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782239954.211078:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5eddf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1868813758958848:12345-0@lo:400:kworker.0 Request processed in 40us (825us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239954.211095:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1782239954.211108:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1782239954.211114:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7e60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1868813758958720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782239954.211146:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7e60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1868813758958720:12345-0@lo:400:kworker.0 Request processed in 32us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239954.211152:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1782239954.211163:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1782239954.211168:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7e62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1868813758959104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782239954.211195:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7e62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1868813758959104:12345-0@lo:400:kworker.0 Request processed in 27us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239954.211209:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00080000:1.0:1782239954.211225:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782239954.211243:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f7e0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1868813758959104:0@lo:400:kworker.0 00000100:00100000:1.0:1782239954.211254:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f7e0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1868813758958720:0@lo:400:kworker.0 00000100:00100000:1.0:1782239954.211613:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f7e0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1868813758958848:0@lo:400:kworker.0 00000100:00100000:3.0:1782239954.213791:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758958592 00000100:00100000:3.0:1782239954.213809:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758958592 00000100:00100000:3.0:1782239954.213898:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1782239954.213909:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d1bacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:3305:x1868813758958592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782239954.214034:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d1bacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:3305:x1868813758958592:12345-0@lo:400:kworker.0 Request processed in 127us (3478us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239954.214057:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1782239954.214224:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1782239954.214234:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb601359c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1868813758958976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782239954.214292:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb601359c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1868813758958976:12345-0@lo:400:kworker.0 Request processed in 61us (4172us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239954.214308:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1782239954.214369:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f7e0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1868813758958976:0@lo:400:kworker.0 00000100:00100000:2.0:1782239954.214586:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f780ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3305:1868813758958592:0@lo:400:kworker.0 00000100:00100000:2.0:1782239954.232447:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239954.232848:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737965312 00000100:00100000:1.0:1782239954.232861:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737965312 00000100:00100000:1.0:1782239954.232995:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 91 00000100:00100000:1.0:1782239954.233007:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+27:10460:x1868813737965312:12345-192.168.203.32@tcp:34:lfs.0 00010000:00010000:1.0:1782239954.233123:0:6611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39400/0x8c5345f1c1ec52fa lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239954.233146:0:6611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39400/0x8c5345f1c1ec52fa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239954.233159:0:6611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39400/0x8c5345f1c1ec52fa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239954.233178:0:6611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39e00/0x8c5345f1c1ec5301 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239954.233203:0:6611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39e00/0x8c5345f1c1ec5301 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239954.233210:0:6611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39e00/0x8c5345f1c1ec5301 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239954.233620:0:6611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38800/0x8c5345f1c1ec5308 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239954.233630:0:6611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38800/0x8c5345f1c1ec5308 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239954.233638:0:6611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38800/0x8c5345f1c1ec5308 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782239954.234163:0:6611:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38800/0x8c5345f1c1ec5308 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239954.234179:0:6611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39400/0x8c5345f1c1ec52fa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239954.234185:0:6611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39400/0x8c5345f1c1ec52fa lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239954.234193:0:6611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39400/0x8c5345f1c1ec52fa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239954.234200:0:6611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f7e39400 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:1.0:1782239954.234205:0:6611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39400/0x8c5345f1c1ec52fa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239954.234214:0:6611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39400/0x8c5345f1c1ec52fa lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239954.234240:0:6611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bb5c4ed6b00) 00010000:00010000:1.0:1782239954.234243:0:6611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782239954.234249:0:6611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39400/0x8c5345f1c1ec52fa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239954.234256:0:6611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39400/0x8c5345f1c1ec52fa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239954.234274:0:6611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39e00/0x8c5345f1c1ec5301 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239954.234281:0:6611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39e00/0x8c5345f1c1ec5301 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239954.234288:0:6611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39e00/0x8c5345f1c1ec5301 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239954.234293:0:6611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f7e39e00 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:1.0:1782239954.234458:0:6611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39e00/0x8c5345f1c1ec5301 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239954.234467:0:6611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39e00/0x8c5345f1c1ec5301 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239954.234477:0:6611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bb5c30e4b00) 00010000:00010000:1.0:1782239954.234480:0:6611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782239954.234484:0:6611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39e00/0x8c5345f1c1ec5301 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239954.234490:0:6611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39e00/0x8c5345f1c1ec5301 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239954.234519:0:6611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38800/0x8c5345f1c1ec5308 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239954.234526:0:6611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38800/0x8c5345f1c1ec5308 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239954.234532:0:6611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38800/0x8c5345f1c1ec5308 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239954.234733:0:6611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f7e38800 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:1.0:1782239954.234737:0:6611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38800/0x8c5345f1c1ec5308 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239954.234745:0:6611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38800/0x8c5345f1c1ec5308 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239954.234800:0:6611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bb5c55deb00) 00010000:00010000:1.0:1782239954.234803:0:6611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782239954.234807:0:6611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38800/0x8c5345f1c1ec5308 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239954.234813:0:6611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38800/0x8c5345f1c1ec5308 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239954.234925:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+27:10460:x1868813737965312:12345-192.168.203.32@tcp:34:lfs.0 Request processed in 1916us (2490us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239954.234936:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 91 00000100:00100000:1.0:1782239954.275262:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239954.275487:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737965568 00000100:00100000:2.0:1782239954.275500:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737965568 00000100:00100000:2.0:1782239954.275688:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 92 00000100:00100000:2.0:1782239954.275702:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7e62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+27:10463:x1868813737965568:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:2.0:1782239954.275730:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782239954.275901:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e000/0x8c5345f1c1ec530f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e5c6 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239954.276006:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec5316 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239954.276025:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec5316 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239954.276039:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec5316 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239954.276057:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fe00/0x8c5345f1c1ec531d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239954.276066:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fe00/0x8c5345f1c1ec531d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239954.276073:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fe00/0x8c5345f1c1ec531d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239954.276709:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e600/0x8c5345f1c1ec5324 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239954.276730:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e600/0x8c5345f1c1ec5324 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239954.276739:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e600/0x8c5345f1c1ec5324 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782239954.276782:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1782239954.276905:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec5316 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239954.276914:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec5316 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239954.276922:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec5316 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239954.276928:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5ee29ea00 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:2.0:1782239954.276933:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec5316 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239954.276942:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec5316 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239954.276957:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bb5c4ed6b00) 00010000:00010000:2.0:1782239954.276960:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782239954.276965:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec5316 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239954.276971:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec5316 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239954.276985:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fe00/0x8c5345f1c1ec531d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239954.276997:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fe00/0x8c5345f1c1ec531d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239954.277004:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fe00/0x8c5345f1c1ec531d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239954.277009:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5ee29fe00 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:2.0:1782239954.277013:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fe00/0x8c5345f1c1ec531d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239954.277019:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fe00/0x8c5345f1c1ec531d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239954.277027:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bb5c4ed6c00) 00010000:00010000:2.0:1782239954.277029:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782239954.277032:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fe00/0x8c5345f1c1ec531d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239954.277038:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fe00/0x8c5345f1c1ec531d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239954.277100:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e000/0x8c5345f1c1ec530f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e5c6 expref: 30 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239954.277116:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e600/0x8c5345f1c1ec5324 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e5c6 expref: 29 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239954.277125:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bb5c55deb00) 00010000:00010000:2.0:1782239954.277127:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1782239954.277137:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5ee29e600, rc 0) 00000100:00100000:2.0:1782239954.277292:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7e62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+29:10463:x1868813737965568:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 1592us (2046us total) trans 4294967370 rc 0/0 00000100:00100000:2.0:1782239954.277302:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 92 00000100:00100000:0.0:1782239954.283738:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239954.283938:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737965696 00000100:00100000:1.0:1782239954.283951:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737965696 00000100:00100000:1.0:1782239954.284075:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 93 00000100:00100000:1.0:1782239954.284096:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5eddf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+29:10463:x1868813737965696:12345-192.168.203.32@tcp:54:lfs.0 00010000:00010000:1.0:1782239954.284187:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38800/0x8c5345f1c1ec5332 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239954.284209:0:5791:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e800/0x8c5345f1c1ec52d7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e5b1 expref: 29 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239954.284221:0:5791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38800/0x8c5345f1c1ec5332 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239954.284265:0:5791:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e800/0x8c5345f1c1ec52d7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e5b1 expref: 29 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239954.284282:0:5791:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e800/0x8c5345f1c1ec52d7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e5b1 expref: 29 pid: 5792 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239954.284419:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f7e63100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5791:1868813758959360:192.168.203.32@tcp:104: 00000100:00100000:1.0:1782239954.284707:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5f7cbd780 going to sleep for 11 seconds 00000100:00100000:3.0:1782239954.288154:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239954.288227:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737965952 00000100:00100000:2.0:1782239954.288242:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737965952 00000100:00100000:2.0:1782239954.288321:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 22 00000100:00100000:2.0:1782239954.288333:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc08df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+30:5564:x1868813737965952:12345-192.168.203.32@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1782239954.288873:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f7e63100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5791:1868813758959360:192.168.203.32@tcp:104: 00010000:00010000:1.0:1782239954.288907:0:5791:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38800/0x8c5345f1c1ec5332 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239954.289951:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc08df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+31:5564:x1868813737965952:12345-192.168.203.32@tcp:35:ldlm_bl.0 Request processed in 1612us (1805us total) trans 4294967371 rc 0/0 00000100:00100000:2.0:1782239954.289965:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 22 00000100:00100000:3.0:1782239954.292827:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239954.292941:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737966080 00000100:00100000:0.0:1782239954.292954:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737966080 00010000:00010000:0.0:1782239954.293006:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e800/0x8c5345f1c1ec52d7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e5b1 expref: 31 pid: 5792 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782239954.293103:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 48 00000100:00100000:0.0:1782239954.293114:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc08d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+31:2344:x1868813737966080:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782239954.293133:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782239954.293141:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e800/0x8c5345f1c1ec52d7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e5b1 expref: 31 pid: 5792 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239954.293157:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e800/0x8c5345f1c1ec52d7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e5b1 expref: 31 pid: 5792 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239954.293185:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e800/0x8c5345f1c1ec52d7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e5b1 expref: 31 pid: 5792 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239954.293206:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bb5c55deb00) 00010000:00010000:0.0:1782239954.293212:0:5776:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38800/0x8c5345f1c1ec5332 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239954.293223:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38800/0x8c5345f1c1ec5332 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239954.293233:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38800/0x8c5345f1c1ec5332 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239954.293275:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782239954.293398:0:5791:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38800/0x8c5345f1c1ec5332 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239954.293408:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38800/0x8c5345f1c1ec5332 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239954.293447:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38800/0x8c5345f1c1ec5332 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239954.293466:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38800/0x8c5345f1c1ec5332 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239954.293473:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38800/0x8c5345f1c1ec5332 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239954.293480:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f7e38800 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:2.0:1782239954.293485:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38800/0x8c5345f1c1ec5332 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239954.293505:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38800/0x8c5345f1c1ec5332 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239954.293516:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bb5c55deb00) 00010000:00010000:2.0:1782239954.293518:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782239954.293522:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38800/0x8c5345f1c1ec5332 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239954.293528:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38800/0x8c5345f1c1ec5332 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239954.293637:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5eddf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+30:10463:x1868813737965696:12345-192.168.203.32@tcp:54:lfs.0 Request processed in 9551us (9912us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239954.293649:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 93 00000100:00100000:0.0:1782239954.295364:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc08d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+29:2344:x1868813737966080:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 2241us (2608us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239954.295378:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 48 00000100:00100000:3.0:1782239954.295708:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239954.296346:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737966336 00000100:00100000:2.0:1782239954.296367:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737966336 00000100:00100000:2.0:1782239954.296427:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 23 00000100:00100000:2.0:1782239954.296438:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc08f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+29:10463:x1868813737966336:12345-192.168.203.32@tcp:35:lfs.0 00000100:00100000:2.0:1782239954.296777:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc08f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+30:10463:x1868813737966336:12345-192.168.203.32@tcp:35:lfs.0 Request processed in 311us (1039us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1782239954.296786:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 23 00000100:00100000:2.0:1782239954.407969:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239954.408072:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737966592 00000100:00100000:3.0:1782239954.408094:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737966592 00000100:00100000:3.0:1782239954.408165:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 94 00000100:00100000:3.0:1782239954.408175:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+30:10474:x1868813737966592:12345-192.168.203.32@tcp:101:cat.0 00010000:00010000:3.0:1782239954.408207:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782239954.408236:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44200/0x8c5345f1c1ec5339 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e5cd expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239954.408324:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44c00/0x8c5345f1c1ec5340 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239954.408342:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44c00/0x8c5345f1c1ec5340 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239954.408366:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44c00/0x8c5345f1c1ec5340 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239954.408385:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec5347 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239954.408393:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec5347 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239954.408400:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec5347 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239954.408986:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044e00/0x8c5345f1c1ec534e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239954.408999:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044e00/0x8c5345f1c1ec534e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239954.409006:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044e00/0x8c5345f1c1ec534e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782239954.409017:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:3.0:1782239954.409135:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44c00/0x8c5345f1c1ec5340 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239954.409143:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44c00/0x8c5345f1c1ec5340 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239954.409151:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44c00/0x8c5345f1c1ec5340 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239954.409157:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5c2a44c00 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:3.0:1782239954.409161:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44c00/0x8c5345f1c1ec5340 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239954.409169:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44c00/0x8c5345f1c1ec5340 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239954.409184:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bb5c4ed6b00) 00010000:00010000:3.0:1782239954.409187:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782239954.409192:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44c00/0x8c5345f1c1ec5340 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239954.409208:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44c00/0x8c5345f1c1ec5340 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239954.409223:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec5347 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239954.409229:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec5347 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239954.409236:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec5347 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239954.409241:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5c2a44000 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:3.0:1782239954.409244:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec5347 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239954.409249:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec5347 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239954.409256:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bb5d0df4100) 00010000:00010000:3.0:1782239954.409258:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782239954.409260:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec5347 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239954.409266:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec5347 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239954.409313:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44200/0x8c5345f1c1ec5339 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e5cd expref: 33 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239954.409326:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044e00/0x8c5345f1c1ec534e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e5cd expref: 32 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239954.409339:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bb5c55deb00) 00010000:00010000:3.0:1782239954.409341:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782239954.409344:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb602044e00, rc 0) 00000100:00100000:3.0:1782239954.410863:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+32:10474:x1868813737966592:12345-192.168.203.32@tcp:101:cat.0 Request processed in 2678us (2899us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1782239954.410878:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 94 00000100:00100000:2.0:1782239954.423850:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239954.424033:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737966848 00000100:00100000:1.0:1782239954.424046:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737966848 00000100:00100000:1.0:1782239954.424128:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 24 00000100:00100000:1.0:1782239954.424140:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+32:10474:x1868813737966848:12345-192.168.203.32@tcp:35:cat.0 00000100:00100000:1.0:1782239954.424491:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+33:10474:x1868813737966848:12345-192.168.203.32@tcp:35:cat.0 Request processed in 352us (656us total) trans 4294967374 rc 0/0 00000100:00100000:1.0:1782239954.424516:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 24 00000100:00100000:1.0:1782239954.479372:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239954.479525:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737967104 00000100:00100000:2.0:1782239954.479547:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737967104 00000100:00100000:2.0:1782239954.479631:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 95 00000100:00100000:2.0:1782239954.479645:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7e63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+33:10475:x1868813737967104:12345-192.168.203.32@tcp:36:rm.0 00010000:00010000:2.0:1782239954.479801:0:6611:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1782239954.479843:0:6611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044e00/0x8c5345f1c1ec534e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e5cd expref: 33 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239954.479871:0:6611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e600/0x8c5345f1c1ec5324 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e5c6 expref: 32 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239954.479887:0:6611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602172c00/0x8c5345f1c1ec52ec lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e5b8 expref: 31 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239954.479900:0:6611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bb5c55deb00) 00010000:00010000:2.0:1782239954.479914:0:6611:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782239954.479940:0:6611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fe00/0x8c5345f1c1ec535c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239954.479957:0:6611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fe00/0x8c5345f1c1ec535c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239954.479969:0:6611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fe00/0x8c5345f1c1ec535c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239954.479986:0:6611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec5363 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239954.479993:0:6611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec5363 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239954.480001:0:6611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec5363 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239954.480446:0:6611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fa00/0x8c5345f1c1ec536a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239954.480459:0:6611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fa00/0x8c5345f1c1ec536a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239954.480467:0:6611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fa00/0x8c5345f1c1ec536a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782239954.481273:0:6611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:2.0:1782239954.481290:0:6611:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 333553540094ns, next at 334553536596ns, rc = 0 00010000:00010000:2.0:1782239954.481381:0:6611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29f200/0x8c5345f1c1ec5371 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239954.481397:0:6611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29f200/0x8c5345f1c1ec5371 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239954.481409:0:6611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29f200/0x8c5345f1c1ec5371 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239954.481421:0:6611:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29f200/0x8c5345f1c1ec5371 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239954.481428:0:6611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29f200/0x8c5345f1c1ec5371 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239954.481435:0:6611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29f200/0x8c5345f1c1ec5371 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239954.481475:0:6611:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782239954.481503:0:6611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fa00/0x8c5345f1c1ec536a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239954.481519:0:6611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fa00/0x8c5345f1c1ec536a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239954.481526:0:6611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fa00/0x8c5345f1c1ec536a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239954.481533:0:6611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5ee29fa00 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:2.0:1782239954.481539:0:6611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fa00/0x8c5345f1c1ec536a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239954.481549:0:6611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fa00/0x8c5345f1c1ec536a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239954.481565:0:6611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bb5c4ed6700) 00010000:00010000:2.0:1782239954.481568:0:6611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1782239954.481572:0:6611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fa00/0x8c5345f1c1ec536a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239954.481579:0:6611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fa00/0x8c5345f1c1ec536a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239954.481602:0:6611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fe00/0x8c5345f1c1ec535c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239954.481609:0:6611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fe00/0x8c5345f1c1ec535c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239954.481615:0:6611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fe00/0x8c5345f1c1ec535c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239954.481620:0:6611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5ee29fe00 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:2.0:1782239954.481631:0:6611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fe00/0x8c5345f1c1ec535c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239954.481638:0:6611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fe00/0x8c5345f1c1ec535c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239954.481647:0:6611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bb5c4ed6b00) 00010000:00010000:2.0:1782239954.481649:0:6611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782239954.481652:0:6611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fe00/0x8c5345f1c1ec535c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239954.481659:0:6611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fe00/0x8c5345f1c1ec535c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782239954.481671:0:6611:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000047f71efc reply state 00000000a6ac9650 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec5363 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239954.481682:0:6611:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782239954.481849:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7e63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+32:10475:x1868813737967104:12345-192.168.203.32@tcp:36:rm.0 Request processed in 2203us (2500us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1782239954.481861:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 95 00010000:00010000:3.0:1782239954.482360:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782239954.482371:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29f200/0x8c5345f1c1ec5371 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239954.482379:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5ee29f200 already unused, calling callback (ffffffffc1728ce0) 00010000:00010000:3.0:1782239954.482384:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29f200/0x8c5345f1c1ec5371 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239954.482391:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29f200/0x8c5345f1c1ec5371 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239954.482403:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bb5c4ed6700) 00010000:00010000:3.0:1782239954.482406:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782239954.482409:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29f200/0x8c5345f1c1ec5371 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239954.482416:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29f200/0x8c5345f1c1ec5371 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239954.482436:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782239954.482438:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782239954.482440:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782239954.485903:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec5363 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239954.485933:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec5363 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239954.485942:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec5363 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239954.485950:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5ee29ea00 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:1.0:1782239954.485957:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec5363 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239954.485968:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec5363 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239954.485994:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bb5c4ed6c00) 00010000:00010000:1.0:1782239954.485997:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782239954.486004:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec5363 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239954.486011:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec5363 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239954.578498:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239954.579847:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737967360 00000100:00100000:2.0:1782239954.579865:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737967360 00000100:00100000:3.0:1782239954.580172:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 96 00000100:00100000:3.0:1782239954.580209:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7e63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+31:10481:x1868813737967360:12345-192.168.203.32@tcp:101:bash.0 00010000:00010000:3.0:1782239954.580247:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782239954.580278:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602045000/0x8c5345f1c1ec5378 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e5d4 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239954.580666:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044a00/0x8c5345f1c1ec537f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239954.580687:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044a00/0x8c5345f1c1ec537f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239954.580700:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044a00/0x8c5345f1c1ec537f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239954.580719:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044e00/0x8c5345f1c1ec5386 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239954.580726:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044e00/0x8c5345f1c1ec5386 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239954.580734:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044e00/0x8c5345f1c1ec5386 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782239954.581962:0:5792:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:3.0:1782239954.582228:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44200/0x8c5345f1c1ec538d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239954.582246:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44200/0x8c5345f1c1ec538d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239954.582260:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44200/0x8c5345f1c1ec538d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239954.582320:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044a00/0x8c5345f1c1ec537f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239954.582329:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044a00/0x8c5345f1c1ec537f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239954.582337:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044a00/0x8c5345f1c1ec537f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239954.582343:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb602044a00 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:3.0:1782239954.582349:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044a00/0x8c5345f1c1ec537f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239954.582357:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044a00/0x8c5345f1c1ec537f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239954.582373:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bb5c4ed6b00) 00010000:00010000:3.0:1782239954.582377:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782239954.582383:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044a00/0x8c5345f1c1ec537f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239954.582390:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044a00/0x8c5345f1c1ec537f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782239954.582407:0:5792:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009980eb3b reply state 00000000997763e0 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044e00/0x8c5345f1c1ec5386 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239954.582418:0:5792:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1782239954.582960:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602045000/0x8c5345f1c1ec5378 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e5d4 expref: 34 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239954.582998:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44200/0x8c5345f1c1ec538d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e5d4 expref: 33 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239954.583007:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bb5d0df4c00) 00010000:00010000:3.0:1782239954.583010:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782239954.583012:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5c2a44200, rc 0) 00000100:00100000:3.0:1782239954.583114:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7e63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+34:10481:x1868813737967360:12345-192.168.203.32@tcp:101:bash.0 Request processed in 2909us (4630us total) trans 4294967376 rc 0/0 00000100:00100000:3.0:1782239954.583124:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 96 00000100:00100000:0.0:1782239954.587832:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00010000:00010000:1.0:1782239954.588004:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044e00/0x8c5345f1c1ec5386 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239954.588021:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044e00/0x8c5345f1c1ec5386 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239954.588046:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044e00/0x8c5345f1c1ec5386 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239954.588053:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb602044e00 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:1.0:1782239954.588058:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044e00/0x8c5345f1c1ec5386 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239954.588067:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044e00/0x8c5345f1c1ec5386 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239954.588096:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bb5d0df4100) 00010000:00010000:1.0:1782239954.588100:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782239954.588106:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044e00/0x8c5345f1c1ec5386 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239954.588113:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044e00/0x8c5345f1c1ec5386 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239954.588394:0:8312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737967488 00000100:00100000:3.0:1782239954.588407:0:8312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737967488 00000100:00100000:3.0:1782239954.588480:0:8312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 34 00000100:00100000:3.0:1782239954.588491:0:8312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5c513ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+7:2345:x1868813737967488:12345-192.168.203.32@tcp:101:bash.0 00010000:00010000:3.0:1782239954.588516:0:8312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782239954.588552:0:8312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000094bc7ff1/0x8c5345f1c1ec539b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e5db expref: -99 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782239954.588584:0:8312:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1782239954.588607:0:8312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=333s v=(0 0) 00010000:00010000:3.0:1782239954.588612:0:8312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782239954.588623:0:8312:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000094bc7ff1/0x8c5345f1c1ec539b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e5db expref: 8 pid: 8312 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239954.588644:0:8312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000094bc7ff1/0x8c5345f1c1ec539b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e5db expref: 8 pid: 8312 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239954.588671:0:8312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5c2a44000, rc 0) 00000100:00100000:3.0:1782239954.588778:0:8312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5c513ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+8:2345:x1868813737967488:12345-192.168.203.32@tcp:101:bash.0 Request processed in 288us (959us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239954.588787:0:8312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 34 00000100:00100000:0.0:1782239954.592269:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239954.592377:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737967616 00000100:00100000:1.0:1782239954.592390:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737967616 00000100:00100000:1.0:1782239954.592471:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 35 00000100:00100000:1.0:1782239954.592483:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5c513e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+8:10481:x1868813737967616:12345-192.168.203.32@tcp:101:bash.0 00010000:00010000:1.0:1782239954.592509:0:6588:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782239954.592535:0:6588:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009d2d3776/0x8c5345f1c1ec53a2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e5e2 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239954.592576:0:6588:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000094bc7ff1/0x8c5345f1c1ec539b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e5db expref: 9 pid: 8312 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239954.592611:0:6588:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782239954.592616:0:6588:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782239954.592623:0:6588:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009d2d3776/0x8c5345f1c1ec53a2 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e5e2 expref: 9 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239954.592668:0:6588:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000094bc7ff1/0x8c5345f1c1ec539b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e5db expref: 9 pid: 8312 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239954.592685:0:6588:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000094bc7ff1/0x8c5345f1c1ec539b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e5db expref: 9 pid: 8312 timeout: 433 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239954.592704:0:6588:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f7e63b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6588:1868813758959488:192.168.203.32@tcp:104: 00000100:00100000:1.0:1782239954.592854:0:6588:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5f7cbd780 going to sleep for 11 seconds 00000100:00100000:1.0:1782239954.599507:0:6588:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f7e63b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6588:1868813758959488:192.168.203.32@tcp:104: 00010000:00010000:1.0:1782239954.599558:0:6588:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009d2d3776/0x8c5345f1c1ec53a2 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e5e2 expref: 9 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239954.599589:0:6588:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5f7e39400, rc 0) 00000100:00100000:1.0:1782239954.599670:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5c513e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+9:10481:x1868813737967616:12345-192.168.203.32@tcp:101:bash.0 Request processed in 7188us (7413us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239954.599681:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 35 00000100:00100000:0.0:1782239954.603925:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239954.604092:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737967744 00000100:00100000:1.0:1782239954.604106:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737967744 00010000:00010000:1.0:1782239954.604172:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000094bc7ff1/0x8c5345f1c1ec539b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e5db expref: 9 pid: 8312 timeout: 433 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239954.604246:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 49 00000100:00100000:1.0:1782239954.604258:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d021b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+9:2344:x1868813737967744:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782239954.604284:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782239954.604325:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000094bc7ff1/0x8c5345f1c1ec539b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e5db expref: 9 pid: 8312 timeout: 433 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239954.604341:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000094bc7ff1/0x8c5345f1c1ec539b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e5db expref: 9 pid: 8312 timeout: 433 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239954.604380:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000094bc7ff1/0x8c5345f1c1ec539b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e5db expref: 9 pid: 8312 timeout: 433 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239954.604403:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782239954.604409:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782239954.604419:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009d2d3776/0x8c5345f1c1ec53a2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e5e2 expref: 8 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239954.604430:0:5775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009d2d3776/0x8c5345f1c1ec53a2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e5e2 expref: 8 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239954.604494:0:5775:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000009d2d3776/0x8c5345f1c1ec53a2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e5e2 expref: 8 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239954.604714:0:5775:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f7e63b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5775:1868813758959616:192.168.203.32@tcp:105: 00000100:00100000:1.0:1782239954.604908:0:5775:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5f7cbd780 going to sleep for 11 seconds 00000100:00100000:1.0:1782239954.614248:0:5775:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f7e63b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5775:1868813758959616:192.168.203.32@tcp:105: 00010000:00010000:1.0:1782239954.614301:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782239954.614394:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d021b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+8:2344:x1868813737967744:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 10137us (10482us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239954.614408:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 49 00000100:00100000:2.0:1782239954.626912:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239954.627317:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737968000 00000100:00100000:1.0:1782239954.627333:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737968000 00000100:00100000:1.0:1782239954.627423:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 25 00000100:00100000:1.0:1782239954.627436:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+33:10481:x1868813737968000:12345-192.168.203.32@tcp:35:bash.0 00000100:00100000:1.0:1782239954.628260:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+34:10481:x1868813737968000:12345-192.168.203.32@tcp:35:bash.0 Request processed in 821us (1359us total) trans 4294967377 rc 0/0 00000100:00100000:1.0:1782239954.628271:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 25 00000040:00080000:0.0:1782239954.655185:0:11535:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1782239954.655199:0:11535:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1782239954.655240:0:11535:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1782239954.655252:0:11535:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1782239954.720652:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fc08ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813758959744:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782239954.720788:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239954.722050:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758959744 00000100:00100000:3.0:1782239954.722074:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758959744 00000100:00100000:3.0:1782239954.722179:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1782239954.722193:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1868813758959744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782239954.722257:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782239954.722503:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1868813758959744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 312us (1714us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239954.722565:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1782239954.722847:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fc08ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813758959744:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782239954.831943:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239954.832074:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737968128 00000100:00100000:2.0:1782239954.832097:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737968128 00000100:00100000:2.0:1782239954.832185:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 97 00000100:00100000:2.0:1782239954.832220:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5c513df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+34:10497:x1868813737968128:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:2.0:1782239954.832258:0:6611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782239954.832288:0:6611:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fa00/0x8c5345f1c1ec53a9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e5e9 expref: -99 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239954.832405:0:6611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e600/0x8c5345f1c1ec53b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239954.832425:0:6611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e600/0x8c5345f1c1ec53b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239954.832439:0:6611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e600/0x8c5345f1c1ec53b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782239954.834742:0:6611:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:2.0:1782239954.834764:0:6611:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1782239954.834802:0:6611:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e600/0x8c5345f1c1ec53b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239954.834859:0:6611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fa00/0x8c5345f1c1ec53a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e5e9 expref: 36 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239954.834892:0:6611:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e600/0x8c5345f1c1ec53b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e5e9 expref: 35 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239954.834903:0:6611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bb5c4ed6b00) 00010000:00010000:2.0:1782239954.834906:0:6611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782239954.834911:0:6611:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5ee29e600, rc 0) 00000100:00100000:2.0:1782239954.835032:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5c513df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+35:10497:x1868813737968128:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 2815us (3103us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239954.835065:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 97 00000100:00100000:0.0:1782239954.843947:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239954.844331:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737968384 00000100:00100000:3.0:1782239954.844347:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737968384 00000100:00100000:3.0:1782239954.844442:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 98 00000100:00100000:3.0:1782239954.844465:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5c513d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+35:10497:x1868813737968384:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:3.0:1782239954.844499:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782239954.844532:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44c00/0x8c5345f1c1ec53b7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e5f0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239954.844685:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec53be lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239954.844704:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec53be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239954.844770:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec53be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782239954.844788:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1782239954.844974:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44c00/0x8c5345f1c1ec53b7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e5f0 expref: 38 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239954.844998:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec53be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e5f0 expref: 37 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239954.845007:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bb5d0df4c00) 00010000:00010000:3.0:1782239954.845011:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782239954.845015:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5c2a44000, rc 0) 00000100:00100000:3.0:1782239954.845118:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5c513d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+37:10497:x1868813737968384:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 666us (1186us total) trans 4294967378 rc 0/0 00000100:00100000:3.0:1782239954.845127:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 98 00000100:00100000:0.0:1782239954.849105:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239954.849658:0:7481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737968512 00000100:00100000:2.0:1782239954.849672:0:7481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737968512 00000100:00100000:2.0:1782239954.849771:0:7481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 6 00000100:00100000:2.0:1782239954.849784:0:7481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5c513c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+37:2346:x1868813737968512:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782239954.849806:0:7481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782239954.849841:0:7481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec53be lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e5f0 expref: 37 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239954.849878:0:7481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bb5d0df4c00) 00010000:00010000:2.0:1782239954.849885:0:7481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782239954.849960:0:7481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5c513c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+36:2346:x1868813737968512:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 179us (878us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239954.849969:0:7481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 6 00000100:00100000:0.0:1782239954.850775:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239954.851297:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737968768 00000100:00100000:2.0:1782239954.851306:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737968768 00000100:00100000:2.0:1782239954.851375:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 99 00000100:00100000:2.0:1782239954.851385:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5c513ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+36:10497:x1868813737968768:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:2.0:1782239954.851418:0:6611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782239954.851450:0:6611:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fa00/0x8c5345f1c1ec53cc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e5f7 expref: -99 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239954.851575:0:6611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ee00/0x8c5345f1c1ec53d3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239954.851592:0:6611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ee00/0x8c5345f1c1ec53d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239954.851622:0:6611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ee00/0x8c5345f1c1ec53d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782239954.851636:0:6611:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1782239954.851840:0:6611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fa00/0x8c5345f1c1ec53cc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e5f7 expref: 39 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239954.852093:0:6611:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ee00/0x8c5345f1c1ec53d3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e5f7 expref: 38 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239954.852105:0:6611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bb5d0df4c00) 00010000:00010000:2.0:1782239954.852108:0:6611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1782239954.852112:0:6611:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5ee29ee00, rc 0) 00000100:00100000:0.0:1782239954.852254:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5c513ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+38:10497:x1868813737968768:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 868us (1478us total) trans 4294967379 rc 0/0 00000100:00100000:0.0:1782239954.852264:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 99 00000100:00100000:0.0:1782239954.858676:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239954.858743:0:8312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737968896 00000100:00100000:3.0:1782239954.858789:0:8312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737968896 00000100:00100000:3.0:1782239954.858866:0:8312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 36 00000100:00100000:3.0:1782239954.858881:0:8312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fbf25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+8:2344:x1868813737968896:12345-192.168.203.32@tcp:1:lfs.0 00010000:00010000:3.0:1782239954.858946:0:8312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5de555c/0x8c5345f1c1ec53e1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239954.858971:0:8312:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009d2d3776/0x8c5345f1c1ec53a2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e5e2 expref: 8 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239954.858981:0:8312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782239954.859004:0:8312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782239954.859009:0:8312:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e5de555c/0x8c5345f1c1ec53e1 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239954.859053:0:8312:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009d2d3776/0x8c5345f1c1ec53a2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e5e2 expref: 8 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239954.859069:0:8312:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009d2d3776/0x8c5345f1c1ec53a2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e5e2 expref: 8 pid: 6588 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239954.859097:0:8312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fc08c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8312:1868813758959872:192.168.203.32@tcp:104: 00000100:00100000:3.0:1782239954.859234:0:8312:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5f7b476c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782239954.862636:0:8312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fc08c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8312:1868813758959872:192.168.203.32@tcp:104: 00010000:00010000:3.0:1782239954.862676:0:8312:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e5de555c/0x8c5345f1c1ec53e1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782239954.866382:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239954.867902:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737969024 00000100:00100000:2.0:1782239954.867924:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737969024 00002000:00100000:2.0:1782239954.868013:0:6595:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9bb5fbf24000 x1868813737969024/t0(0) o4->36dd742b-25b8-431e-bf41-75f2fff47ffb@192.168.203.32@tcp:555/0 lens 504/0 e 0 to 0 dl 1782239965 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782239954.868026:0:6595:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9bb5fbf24000 with x1868813737969024 ext(0->8) 00010000:00010000:2.0:1782239954.868038:0:6595:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000009d2d3776/0x8c5345f1c1ec53a2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e5e2 expref: 9 pid: 6588 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239954.868059:0:6595:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000009d2d3776/0x8c5345f1c1ec53a2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e5e2 expref: 9 pid: 6588 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782239954.868068:0:6595:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9bb5fbf24000 00000100:00100000:2.0:1782239954.868122:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 1 00000100:00100000:2.0:1782239954.868134:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fbf24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+9:2345:x1868813737969024:12345-192.168.203.32@tcp:4:lfs.0 00000100:00100000:2.0:1782239954.868795:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fbf24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+11:2345:x1868813737969024:12345-192.168.203.32@tcp:4:lfs.0 Request processed in 661us (2434us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1782239954.868806:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 1 00002000:00100000:2.0:1782239954.868814:0:6595:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9bb5fbf24000 x1868813737969024/t4294967302(0) o4->36dd742b-25b8-431e-bf41-75f2fff47ffb@192.168.203.32@tcp:555/0 lens 504/448 e 0 to 0 dl 1782239965 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782239954.868823:0:6595:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9bb5fbf24000 with x1868813737969024 ext(0->8) 00010000:00010000:2.0:1782239954.868828:0:6595:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000009d2d3776/0x8c5345f1c1ec53a2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e5e2 expref: 11 pid: 6588 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239954.868842:0:6595:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000009d2d3776/0x8c5345f1c1ec53a2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e5e2 expref: 11 pid: 6588 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782239954.868848:0:6595:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9bb5fbf24000 00000100:00100000:2.0:1782239954.873062:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239954.876543:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737969152 00000100:00100000:0.0:1782239954.876567:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737969152 00010000:00010000:0.0:1782239954.876640:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009d2d3776/0x8c5345f1c1ec53a2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e5e2 expref: 11 pid: 6588 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782239954.876783:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 50 00000100:00100000:0.0:1782239954.876794:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f780ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+11:2346:x1868813737969152:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782239954.876814:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1782239954.876855:0:5777:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1782239954.876858:0:5777:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1782239954 00002000:00010000:0.0:1782239954.876860:0:5777:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1782239954 00002000:00010000:0.0:1782239954.876862:0:5777:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1782239954 00010000:00010000:0.0:1782239954.876869:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009d2d3776/0x8c5345f1c1ec53a2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e5e2 expref: 11 pid: 6588 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239954.876884:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009d2d3776/0x8c5345f1c1ec53a2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e5e2 expref: 11 pid: 6588 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239954.876916:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009d2d3776/0x8c5345f1c1ec53a2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e5e2 expref: 11 pid: 6588 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239954.877439:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782239954.877446:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782239954.877516:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e5de555c/0x8c5345f1c1ec53e1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239954.877529:0:5777:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e5de555c/0x8c5345f1c1ec53e1 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239954.877638:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782239954.878706:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f780ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+10:2346:x1868813737969152:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 943us (4687us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239954.878721:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 50 00010000:00010000:3.0:1782239954.880184:0:8312:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e5de555c/0x8c5345f1c1ec53e1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239954.880209:0:8312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e5de555c/0x8c5345f1c1ec53e1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239954.880260:0:8312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5de555c/0x8c5345f1c1ec53e1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239954.880270:0:8312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e5de555c/0x8c5345f1c1ec53e1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239954.880301:0:8312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e5de555c/0x8c5345f1c1ec53e1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239954.880309:0:8312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5c2a44c00 already unused, calling callback (ffffffffc1728ce0) 00010000:00010000:3.0:1782239954.880314:0:8312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5de555c/0x8c5345f1c1ec53e1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239954.880324:0:8312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5de555c/0x8c5345f1c1ec53e1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239954.880348:0:8312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e5de555c/0x8c5345f1c1ec53e1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239954.880617:0:8312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e5de555c/0x8c5345f1c1ec53e1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239954.880836:0:8312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fbf25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+9:2344:x1868813737968896:12345-192.168.203.32@tcp:1:lfs.0 Request processed in 21952us (22169us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239954.880849:0:8312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 36 00000100:00100000:0.0:1782239954.883572:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239954.883639:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737969408 00000100:00100000:3.0:1782239954.883652:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737969408 00000100:00100000:3.0:1782239954.883717:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 26 00000100:00100000:3.0:1782239954.883729:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5c779c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+38:10497:x1868813737969408:12345-192.168.203.32@tcp:35:lfs.0 00000004:00010000:3.0:1782239954.883831:0:5794:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ee00/0x8c5345f1c1ec53d3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e5f7 expref: 38 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782239954.884244:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:3.0:1782239954.884294:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:3.0:1782239954.884698:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:3.0:1782239954.884789:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec53e8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239954.884807:0:5794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44200/0x8c5345f1c1ec538d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e5d4 expref: 42 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239954.884818:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec53e8 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239954.884870:0:5794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44200/0x8c5345f1c1ec538d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e5d4 expref: 42 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239954.884888:0:5794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44200/0x8c5345f1c1ec538d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e5d4 expref: 42 pid: 5792 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239954.884909:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fc08c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5794:1868813758960000:192.168.203.32@tcp:104: 00000100:00100000:3.0:1782239954.887213:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5f7b47cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1782239954.889920:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fc08c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5794:1868813758960000:192.168.203.32@tcp:104: 00010000:00010000:3.0:1782239954.891578:0:5794:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec53e8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239954.900129:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239954.906465:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737969536 00000100:00100000:2.0:1782239954.906488:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737969536 00010000:00010000:2.0:1782239954.906565:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44200/0x8c5345f1c1ec538d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e5d4 expref: 43 pid: 5792 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239954.906631:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 51 00000100:00100000:2.0:1782239954.906644:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7e63480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+43:2344:x1868813737969536:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782239954.906667:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782239954.906676:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44200/0x8c5345f1c1ec538d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e5d4 expref: 43 pid: 5792 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239954.906693:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44200/0x8c5345f1c1ec538d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e5d4 expref: 43 pid: 5792 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239954.906745:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44200/0x8c5345f1c1ec538d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e5d4 expref: 43 pid: 5792 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239954.906791:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bb5d0df4c00) 00010000:00010000:2.0:1782239954.906798:0:5776:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec53e8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239954.906810:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec53e8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239954.906819:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec53e8 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239954.906860:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782239954.906945:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7e63480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+42:2344:x1868813737969536:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 303us (6828us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239954.906954:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 51 00010000:00010000:3.0:1782239954.907204:0:5794:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec53e8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239954.907216:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec53e8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782239954.907435:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:3.0:1782239954.907704:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:3.0:1782239954.907909:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fc08c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5794:1868813758960128:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1782239954.908013:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239954.908064:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5f7b473c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782239954.908109:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758960128 00000100:00100000:3.0:1782239954.908116:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758960128 00000100:00100000:3.0:1782239954.908172:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1782239954.908180:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc08ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5794:x1868813758960128:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1782239954.908281:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc08ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5794:x1868813758960128:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 101us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239954.908289:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1782239954.908335:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fc08c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5794:1868813758960128:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1782239954.908925:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:3.0:1782239954.908998:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fc08c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5794:1868813758960256:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1782239954.909043:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239954.909070:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5f7b47cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1782239954.909103:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758960256 00000100:00100000:3.0:1782239954.909109:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758960256 00000100:00100000:3.0:1782239954.909138:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1782239954.909144:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc08c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5794:x1868813758960256:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1782239954.909320:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc08c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:5794:x1868813758960256:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 174us (275us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1782239954.909328:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1782239954.909368:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fc08c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5794:1868813758960256:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1782239954.909427:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:3.0:1782239954.909467:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec53e8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239954.909478:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec53e8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239954.909485:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec53e8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239954.909493:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5c2a44000 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:3.0:1782239954.909498:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec53e8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239954.909507:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec53e8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239954.909525:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bb5d0df4c00) 00010000:00010000:3.0:1782239954.909529:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1782239954.909533:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec53e8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239954.909540:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec53e8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782239954.909720:0:5794:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1782239954.909878:0:5794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:3.0:1782239954.909893:0:5794:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 333982144263ns, next at 334982141272ns, rc = 0 00000001:00080000:3.0:1782239954.909901:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:3.0:1782239954.909935:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bb5d0df4c00) 00010000:00010000:3.0:1782239954.909938:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1782239954.909956:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ee00/0x8c5345f1c1ec53d3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e5f7 expref: 46 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239954.910065:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5c779c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+45:10497:x1868813737969408:12345-192.168.203.32@tcp:35:lfs.0 Request processed in 26338us (26506us total) trans 4294967388 rc 0/0 00000100:00100000:3.0:1782239954.910075:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 26 00000020:00080000:3.0:1782239954.917639:0:5794:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1782239954.918320:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239954.918455:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737969664 00000100:00100000:3.0:1782239954.918468:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737969664 00000100:00100000:3.0:1782239954.918542:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 100 00000100:00100000:3.0:1782239954.918555:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+45:10497:x1868813737969664:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:3.0:1782239954.918586:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782239954.918617:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44c00/0x8c5345f1c1ec53ef lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e5fe expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239954.918696:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44c00/0x8c5345f1c1ec53ef lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e5fe expref: 46 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239954.918714:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44c00/0x8c5345f1c1ec53ef lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e5fe expref: 46 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239954.918736:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bb5d0df4300) 00010000:00010000:3.0:1782239954.918740:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782239954.918744:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5c2a44c00, rc 0) 00000100:00100000:3.0:1782239954.918839:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+46:10497:x1868813737969664:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 286us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239954.918847:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 100 00000100:00100000:0.0:1782239954.924719:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239954.925239:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737969920 00000100:00100000:1.0:1782239954.925254:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737969920 00000100:00100000:1.0:1782239954.925396:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 27 00000100:00100000:1.0:1782239954.925409:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+46:10497:x1868813737969920:12345-192.168.203.32@tcp:35:lfs.0 00000100:00100000:1.0:1782239954.925807:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+47:10497:x1868813737969920:12345-192.168.203.32@tcp:35:lfs.0 Request processed in 400us (1103us total) trans 4294967389 rc 0/0 00000100:00100000:1.0:1782239954.925816:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 27 00000100:00100000:1.0:1782239955.025231:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239955.025327:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737970048 00000100:00100000:2.0:1782239955.025341:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737970048 00000100:00100000:2.0:1782239955.025438:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 101 00000100:00100000:2.0:1782239955.025463:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7e60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+47:10507:x1868813737970048:12345-192.168.203.32@tcp:34:lfs.0 00010000:00010000:2.0:1782239955.025593:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fc00/0x8c5345f1c1ec53f6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239955.025620:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fc00/0x8c5345f1c1ec53f6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239955.025639:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fc00/0x8c5345f1c1ec53f6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239955.025682:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ee00/0x8c5345f1c1ec53fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239955.025690:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ee00/0x8c5345f1c1ec53fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239955.025697:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ee00/0x8c5345f1c1ec53fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239955.025883:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e200/0x8c5345f1c1ec5404 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239955.025892:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e200/0x8c5345f1c1ec5404 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239955.025900:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e200/0x8c5345f1c1ec5404 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782239955.025954:0:5791:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e200/0x8c5345f1c1ec5404 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239955.025970:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fc00/0x8c5345f1c1ec53f6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239955.025977:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fc00/0x8c5345f1c1ec53f6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239955.025984:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fc00/0x8c5345f1c1ec53f6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239955.025991:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5ee29fc00 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:2.0:1782239955.025996:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fc00/0x8c5345f1c1ec53f6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239955.026014:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fc00/0x8c5345f1c1ec53f6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239955.026030:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bb5c4ed6b00) 00010000:00010000:2.0:1782239955.026034:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782239955.026039:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fc00/0x8c5345f1c1ec53f6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239955.026045:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fc00/0x8c5345f1c1ec53f6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239955.026062:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ee00/0x8c5345f1c1ec53fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239955.026067:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ee00/0x8c5345f1c1ec53fd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239955.026072:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ee00/0x8c5345f1c1ec53fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239955.026077:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5ee29ee00 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:2.0:1782239955.026092:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ee00/0x8c5345f1c1ec53fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239955.026098:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ee00/0x8c5345f1c1ec53fd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239955.026105:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bb5c4ed6500) 00010000:00010000:2.0:1782239955.026108:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782239955.026110:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ee00/0x8c5345f1c1ec53fd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239955.026127:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ee00/0x8c5345f1c1ec53fd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239955.026146:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e200/0x8c5345f1c1ec5404 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239955.026152:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e200/0x8c5345f1c1ec5404 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239955.026158:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e200/0x8c5345f1c1ec5404 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239955.026163:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5ee29e200 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:2.0:1782239955.026166:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e200/0x8c5345f1c1ec5404 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239955.026171:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e200/0x8c5345f1c1ec5404 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239955.026179:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bb5d0df4300) 00010000:00010000:2.0:1782239955.026181:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782239955.026184:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e200/0x8c5345f1c1ec5404 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239955.026190:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e200/0x8c5345f1c1ec5404 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239955.026290:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7e60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+47:10507:x1868813737970048:12345-192.168.203.32@tcp:34:lfs.0 Request processed in 840us (1075us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239955.026300:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 101 00000100:00080000:1.0:1782239955.026904:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782239955.097797:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239955.097920:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737970304 00000100:00100000:3.0:1782239955.097946:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737970304 00000100:00100000:3.0:1782239955.098022:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 102 00000100:00100000:3.0:1782239955.098034:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ee2ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+47:10510:x1868813737970304:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:3.0:1782239955.098062:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782239955.098099:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec540b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e605 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239955.098199:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44200/0x8c5345f1c1ec5412 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239955.098217:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44200/0x8c5345f1c1ec5412 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239955.098231:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44200/0x8c5345f1c1ec5412 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239955.098264:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26800/0x8c5345f1c1ec5419 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239955.098273:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26800/0x8c5345f1c1ec5419 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239955.098281:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26800/0x8c5345f1c1ec5419 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239955.098468:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26400/0x8c5345f1c1ec5420 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239955.098477:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26400/0x8c5345f1c1ec5420 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239955.098484:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26400/0x8c5345f1c1ec5420 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782239955.098503:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1782239955.098628:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44200/0x8c5345f1c1ec5412 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239955.098637:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44200/0x8c5345f1c1ec5412 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239955.098644:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44200/0x8c5345f1c1ec5412 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239955.098651:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5c2a44200 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:3.0:1782239955.098656:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44200/0x8c5345f1c1ec5412 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239955.098665:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44200/0x8c5345f1c1ec5412 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239955.098680:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bb5c4ed6b00) 00010000:00010000:3.0:1782239955.098683:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782239955.098688:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44200/0x8c5345f1c1ec5412 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239955.098695:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44200/0x8c5345f1c1ec5412 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239955.098711:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26800/0x8c5345f1c1ec5419 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239955.098718:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26800/0x8c5345f1c1ec5419 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239955.098736:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26800/0x8c5345f1c1ec5419 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239955.098742:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f7e26800 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:3.0:1782239955.098803:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26800/0x8c5345f1c1ec5419 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239955.098812:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26800/0x8c5345f1c1ec5419 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239955.098821:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bb5d0df4c00) 00010000:00010000:3.0:1782239955.098824:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782239955.098827:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26800/0x8c5345f1c1ec5419 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239955.098833:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26800/0x8c5345f1c1ec5419 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239955.098882:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44000/0x8c5345f1c1ec540b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e605 expref: 50 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239955.098897:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26400/0x8c5345f1c1ec5420 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e605 expref: 49 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239955.098905:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bb5d0df4300) 00010000:00010000:3.0:1782239955.098907:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782239955.098909:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5f7e26400, rc 0) 00000100:00100000:3.0:1782239955.098990:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ee2ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+49:10510:x1868813737970304:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 957us (1242us total) trans 4294967390 rc 0/0 00000100:00100000:3.0:1782239955.099008:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 102 00000100:00100000:0.0:1782239955.108804:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239955.108886:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737970432 00000100:00100000:2.0:1782239955.108898:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737970432 00000100:00100000:2.0:1782239955.108975:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 103 00000100:00100000:2.0:1782239955.108988:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ee2fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+49:10510:x1868813737970432:12345-192.168.203.32@tcp:54:lfs.0 00010000:00010000:2.0:1782239955.109104:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e200/0x8c5345f1c1ec542e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239955.109130:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e200/0x8c5345f1c1ec542e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239955.109145:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e200/0x8c5345f1c1ec542e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239955.109181:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e200/0x8c5345f1c1ec542e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239955.109189:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e200/0x8c5345f1c1ec542e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239955.109197:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e200/0x8c5345f1c1ec542e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239955.109203:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5ee29e200 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:2.0:1782239955.109209:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e200/0x8c5345f1c1ec542e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239955.109218:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e200/0x8c5345f1c1ec542e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239955.109232:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bb5d0df4300) 00010000:00010000:2.0:1782239955.109235:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782239955.109240:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e200/0x8c5345f1c1ec542e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239955.109266:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e200/0x8c5345f1c1ec542e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239955.109381:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ee2fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+49:10510:x1868813737970432:12345-192.168.203.32@tcp:54:lfs.0 Request processed in 396us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239955.109390:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 103 00000100:00100000:1.0:1782239955.117958:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239955.120858:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737970688 00000100:00100000:3.0:1782239955.120879:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737970688 00000100:00100000:3.0:1782239955.121049:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 28 00000100:00100000:3.0:1782239955.121065:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7e60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+49:10510:x1868813737970688:12345-192.168.203.32@tcp:35:lfs.0 00000100:00100000:3.0:1782239955.122305:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7e60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+50:10510:x1868813737970688:12345-192.168.203.32@tcp:35:lfs.0 Request processed in 386us (3508us total) trans 4294967391 rc 0/0 00000100:00100000:3.0:1782239955.122324:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 28 00010000:00010000:2.0:1782239955.167188:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782239955.260674:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239955.262875:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737970944 00000100:00100000:3.0:1782239955.262898:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737970944 00000100:00100000:3.0:1782239955.263004:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 104 00000100:00100000:3.0:1782239955.263017:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7e63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+50:10520:x1868813737970944:12345-192.168.203.32@tcp:101:bash.0 00010000:00010000:3.0:1782239955.263058:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782239955.263063:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1782239955.263117:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e600/0x8c5345f1c1ec53b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e5e9 expref: 50 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239955.263144:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bb5c4ed6b00) 00010000:00010000:3.0:1782239955.263151:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782239955.263170:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26800/0x8c5345f1c1ec5435 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e60c expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239955.263944:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26e00/0x8c5345f1c1ec543c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239955.263966:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26e00/0x8c5345f1c1ec543c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239955.263998:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26e00/0x8c5345f1c1ec543c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782239955.264013:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1782239955.264374:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26800/0x8c5345f1c1ec5435 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e60c expref: 52 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239955.264404:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26e00/0x8c5345f1c1ec543c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e60c expref: 51 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239955.264414:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bb5d0df4300) 00010000:00010000:3.0:1782239955.264417:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782239955.264437:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5f7e26e00, rc 0) 00000100:00100000:3.0:1782239955.264573:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7e63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+51:10520:x1868813737970944:12345-192.168.203.32@tcp:101:bash.0 Request processed in 1549us (3905us total) trans 4294967392 rc 0/0 00000100:00100000:3.0:1782239955.264583:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 104 00000100:00100000:0.0:1782239955.278070:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239955.278212:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737971200 00000100:00100000:2.0:1782239955.278227:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737971200 00000100:00100000:2.0:1782239955.278313:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 105 00000100:00100000:2.0:1782239955.278325:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ee2ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+51:10520:x1868813737971200:12345-192.168.203.32@tcp:36:bash.0 00010000:00010000:2.0:1782239955.278412:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1782239955.278459:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26e00/0x8c5345f1c1ec543c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e60c expref: 51 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239955.278487:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26400/0x8c5345f1c1ec5420 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e605 expref: 50 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239955.278500:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bb5d0df4300) 00010000:00010000:2.0:1782239955.278506:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782239955.278899:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e200/0x8c5345f1c1ec544a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239955.278915:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e200/0x8c5345f1c1ec544a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239955.278925:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e200/0x8c5345f1c1ec544a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782239955.279009:0:5791:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:2.0:1782239955.279035:0:5791:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000006526c7f reply state 00000000e9cd399b transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e200/0x8c5345f1c1ec544a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239955.279044:0:5791:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782239955.279176:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ee2ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+52:10520:x1868813737971200:12345-192.168.203.32@tcp:36:bash.0 Request processed in 853us (1122us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1782239955.279186:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 105 00000020:00080000:2.0:1782239955.279192:0:5791:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1782239955.286032:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e200/0x8c5345f1c1ec544a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239955.286057:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e200/0x8c5345f1c1ec544a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239955.286066:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e200/0x8c5345f1c1ec544a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239955.286074:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5ee29e200 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:0.0:1782239955.286090:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e200/0x8c5345f1c1ec544a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239955.286099:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e200/0x8c5345f1c1ec544a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239955.286124:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bb5d0df4300) 00010000:00010000:0.0:1782239955.286127:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782239955.286133:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e200/0x8c5345f1c1ec544a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239955.286140:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e200/0x8c5345f1c1ec544a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782239955.292325:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239955.292604:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737971328 00000100:00100000:3.0:1782239955.292620:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737971328 00000100:00100000:3.0:1782239955.292699:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 106 00000100:00100000:3.0:1782239955.292711:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ee2fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+51:10520:x1868813737971328:12345-192.168.203.32@tcp:101:bash.0 00010000:00010000:3.0:1782239955.292745:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782239955.292800:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26800/0x8c5345f1c1ec5451 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e613 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239955.292958:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26a00/0x8c5345f1c1ec5458 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239955.292989:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26a00/0x8c5345f1c1ec5458 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239955.293003:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26a00/0x8c5345f1c1ec5458 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782239955.293047:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1782239955.293054:0:5790:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782239955.293264:0:5790:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26a00/0x8c5345f1c1ec5458 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239955.293300:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26800/0x8c5345f1c1ec5451 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e613 expref: 53 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239955.293322:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26a00/0x8c5345f1c1ec5458 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e613 expref: 52 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239955.293331:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bb5d0df4300) 00010000:00010000:3.0:1782239955.293334:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782239955.293338:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5f7e26a00, rc 0) 00000100:00100000:3.0:1782239955.293424:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ee2fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+52:10520:x1868813737971328:12345-192.168.203.32@tcp:101:bash.0 Request processed in 715us (1115us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239955.293433:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 106 00000100:00100000:1.0:1782239955.302886:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239955.303016:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737971584 00000100:00100000:2.0:1782239955.303030:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737971584 00000100:00100000:2.0:1782239955.303111:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 29 00000100:00100000:2.0:1782239955.303125:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7e0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+52:10520:x1868813737971584:12345-192.168.203.32@tcp:35:bash.0 00000100:00100000:2.0:1782239955.303472:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7e0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+53:10520:x1868813737971584:12345-192.168.203.32@tcp:35:bash.0 Request processed in 349us (598us total) trans 4294967395 rc 0/0 00000100:00100000:2.0:1782239955.303482:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 29 00000100:00100000:1.0:1782239955.375950:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239955.376057:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737971712 00000100:00100000:2.0:1782239955.376070:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737971712 00000100:00100000:2.0:1782239955.376167:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 107 00000100:00100000:2.0:1782239955.376180:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7e0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+53:10526:x1868813737971712:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:2.0:1782239955.376217:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782239955.376245:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ee00/0x8c5345f1c1ec545f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e61a expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239955.376339:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fc00/0x8c5345f1c1ec5466 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239955.376393:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fc00/0x8c5345f1c1ec5466 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239955.376420:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fc00/0x8c5345f1c1ec5466 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782239955.376516:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:2.0:1782239955.376521:0:5791:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1782239955.376548:0:5791:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fc00/0x8c5345f1c1ec5466 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239955.376581:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ee00/0x8c5345f1c1ec545f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e61a expref: 55 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239955.376604:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fc00/0x8c5345f1c1ec5466 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e61a expref: 54 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239955.376615:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bb5c4ed6b00) 00010000:00010000:2.0:1782239955.376619:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782239955.376623:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5ee29fc00, rc 0) 00000100:00100000:2.0:1782239955.376701:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7e0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+54:10526:x1868813737971712:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 524us (766us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239955.376711:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 107 00000100:00100000:0.0:1782239955.386098:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239955.386543:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737971840 00000100:00100000:2.0:1782239955.386557:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737971840 00000100:00100000:2.0:1782239955.386699:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 108 00000100:00100000:2.0:1782239955.386713:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ffd6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+54:10526:x1868813737971840:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:2.0:1782239955.386743:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782239955.386825:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ee00/0x8c5345f1c1ec546d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e621 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239955.386934:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fa00/0x8c5345f1c1ec5474 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239955.386952:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fa00/0x8c5345f1c1ec5474 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239955.386967:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fa00/0x8c5345f1c1ec5474 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239955.386983:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e400/0x8c5345f1c1ec547b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239955.386991:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e400/0x8c5345f1c1ec547b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239955.386997:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e400/0x8c5345f1c1ec547b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239955.387127:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fe00/0x8c5345f1c1ec5482 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239955.387136:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fe00/0x8c5345f1c1ec5482 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239955.387143:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fe00/0x8c5345f1c1ec5482 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782239955.387182:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1782239955.387186:0:5792:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782239955.387205:0:5792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fe00/0x8c5345f1c1ec5482 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239955.387228:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fe00/0x8c5345f1c1ec5482 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239955.387237:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fa00/0x8c5345f1c1ec5474 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239955.387245:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fa00/0x8c5345f1c1ec5474 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239955.387252:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fa00/0x8c5345f1c1ec5474 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239955.387259:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5ee29fa00 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:2.0:1782239955.387263:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fa00/0x8c5345f1c1ec5474 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239955.387271:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fa00/0x8c5345f1c1ec5474 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239955.387284:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bb5c4ed6b00) 00010000:00010000:2.0:1782239955.387287:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782239955.387292:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fa00/0x8c5345f1c1ec5474 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239955.387298:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fa00/0x8c5345f1c1ec5474 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239955.387313:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e400/0x8c5345f1c1ec547b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239955.387319:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e400/0x8c5345f1c1ec547b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239955.387330:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e400/0x8c5345f1c1ec547b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239955.387335:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5ee29e400 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:2.0:1782239955.387338:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e400/0x8c5345f1c1ec547b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239955.387344:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e400/0x8c5345f1c1ec547b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239955.387350:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bb5c4ed6500) 00010000:00010000:2.0:1782239955.387352:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782239955.387365:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e400/0x8c5345f1c1ec547b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239955.387371:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e400/0x8c5345f1c1ec547b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239955.387410:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ee00/0x8c5345f1c1ec546d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e621 expref: 56 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239955.387548:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fe00/0x8c5345f1c1ec5482 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e621 expref: 55 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239955.387557:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bb5d0df4300) 00010000:00010000:2.0:1782239955.387559:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782239955.387562:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5ee29fe00, rc 0) 00000100:00100000:2.0:1782239955.387722:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ffd6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+55:10526:x1868813737971840:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 1012us (1646us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239955.387740:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 108 00000100:00100000:1.0:1782239955.392190:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239955.392651:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239955.392730:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737972224 00000100:00100000:1.0:1782239955.392743:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737972224 00000100:00100000:0.0:1782239955.393096:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 7 00000100:00100000:0.0:1782239955.393133:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ffd6f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+55:2346:x1868813737972224:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782239955.393157:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782239955.393194:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fe00/0x8c5345f1c1ec5482 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e621 expref: 55 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239955.393218:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bb5d0df4300) 00010000:00010000:0.0:1782239955.393224:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782239955.393300:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ffd6f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+54:2346:x1868813737972224:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 171us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239955.393308:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 7 00000100:00100000:2.0:1782239955.393623:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737972096 00000100:00100000:2.0:1782239955.393631:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737972096 00000100:00100000:2.0:1782239955.393671:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 109 00000100:00100000:2.0:1782239955.393679:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7e0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+54:10526:x1868813737972096:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:2.0:1782239955.393702:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782239955.393720:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ee00/0x8c5345f1c1ec5489 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e628 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239955.393884:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e400/0x8c5345f1c1ec5490 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239955.393901:0:5791:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26a00/0x8c5345f1c1ec5458 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e613 expref: 55 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239955.393911:0:5791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e400/0x8c5345f1c1ec5490 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239955.395394:0:5791:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26a00/0x8c5345f1c1ec5458 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e613 expref: 55 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239955.395428:0:5791:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26a00/0x8c5345f1c1ec5458 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e613 expref: 55 pid: 5790 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239955.395449:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f7c0f800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5791:1868813758960384:192.168.203.32@tcp:104: 00000100:00100000:2.0:1782239955.395563:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c2ed26c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782239955.400228:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239955.400272:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737972352 00000100:00100000:3.0:1782239955.400284:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737972352 00010000:00010000:3.0:1782239955.400336:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26a00/0x8c5345f1c1ec5458 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e613 expref: 56 pid: 5790 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239955.400414:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 52 00000100:00100000:3.0:1782239955.400432:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc08df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+56:2345:x1868813737972352:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782239955.400462:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782239955.400471:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26a00/0x8c5345f1c1ec5458 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e613 expref: 56 pid: 5790 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239955.400488:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26a00/0x8c5345f1c1ec5458 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e613 expref: 56 pid: 5790 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239955.400516:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bb5d0df4300) 00010000:00010000:3.0:1782239955.400523:0:5776:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e400/0x8c5345f1c1ec5490 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239955.400535:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e400/0x8c5345f1c1ec5490 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239955.400543:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e400/0x8c5345f1c1ec5490 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239955.400566:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782239955.400628:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc08df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+56:2345:x1868813737972352:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 197us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239955.400636:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 52 00010000:00010000:2.0:1782239955.403200:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26a00/0x8c5345f1c1ec5458 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e613 expref: 55 pid: 5790 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239955.403279:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f7c0f800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5791:1868813758960384:192.168.203.32@tcp:104: 00010000:00010000:2.0:1782239955.403318:0:5791:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e400/0x8c5345f1c1ec5490 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239955.403329:0:5791:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e400/0x8c5345f1c1ec5490 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239955.403335:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e400/0x8c5345f1c1ec5490 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782239955.403373:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1782239955.403592:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ee00/0x8c5345f1c1ec5489 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e628 expref: 56 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239955.403612:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e400/0x8c5345f1c1ec5490 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e628 expref: 55 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239955.403623:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bb5d0df4300) 00010000:00010000:2.0:1782239955.403626:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1782239955.403630:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5ee29e400, rc 0) 00000100:00100000:2.0:1782239955.403723:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7e0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+55:10526:x1868813737972096:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 10043us (11548us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1782239955.403733:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 109 00000100:00100000:3.0:1782239955.421193:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239955.421297:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737972608 00000100:00100000:0.0:1782239955.421310:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737972608 00000100:00100000:0.0:1782239955.421410:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 8 00000100:00100000:0.0:1782239955.421430:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc08f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+55:10526:x1868813737972608:12345-192.168.203.32@tcp:103:lfs.0 00010000:00010000:0.0:1782239955.421461:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782239955.421498:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44c00/0x8c5345f1c1ec53ef lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e5fe expref: 55 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239955.421524:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bb5d0df4300) 00010000:00010000:0.0:1782239955.421531:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782239955.421618:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc08f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+54:10526:x1868813737972608:12345-192.168.203.32@tcp:103:lfs.0 Request processed in 197us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239955.421625:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 8 00000100:00100000:0.0:1782239955.431032:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239955.431354:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737972736 00000100:00100000:3.0:1782239955.431368:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737972736 00000100:00100000:3.0:1782239955.431465:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 110 00000100:00100000:3.0:1782239955.431498:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ffd6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+54:10526:x1868813737972736:12345-192.168.203.32@tcp:58:lfs.0 00010000:00010000:3.0:1782239955.431662:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27a00/0x8c5345f1c1ec549e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239955.431685:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27a00/0x8c5345f1c1ec549e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239955.431702:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27a00/0x8c5345f1c1ec549e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782239955.432233:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:3.0:1782239955.432353:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ffd6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+54:10526:x1868813737972736:12345-192.168.203.32@tcp:58:lfs.0 Request processed in 855us (1333us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239955.432363:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 110 00000100:00100000:1.0:1782239955.436149:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239955.437090:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737972864 00000100:00100000:0.0:1782239955.437109:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737972864 00000100:00100000:0.0:1782239955.437222:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 111 00000100:00100000:0.0:1782239955.437235:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7e0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+54:10526:x1868813737972864:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:0.0:1782239955.437262:0:6611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782239955.437291:0:6611:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602173800/0x8c5345f1c1ec54a5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e62f expref: -99 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239955.437374:0:6611:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27a00/0x8c5345f1c1ec549e lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239955.437387:0:6611:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602173800/0x8c5345f1c1ec54a5 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e62f expref: 55 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239955.437410:0:6611:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27a00/0x8c5345f1c1ec549e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239955.437426:0:6611:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602173800/0x8c5345f1c1ec54a5 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e62f expref: 55 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239955.437443:0:6611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bb5d0df4300) 00010000:00010000:0.0:1782239955.437447:0:6611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782239955.437451:0:6611:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602173800/0x8c5345f1c1ec54a5 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e62f expref: 55 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239955.437461:0:6611:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb602173800, rc 0) 00000100:00100000:0.0:1782239955.437564:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7e0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+55:10526:x1868813737972864:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 331us (1430us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239955.437573:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 111 00000040:00080000:0.0:1782239955.679207:0:11535:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1782239955.679244:0:11535:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1782239955.679318:0:11535:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1782239955.679330:0:11535:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1782239955.680051:0:11535:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5ffd6df80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11535:1868813758960512:192.168.203.32@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1782239955.680214:0:11535:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c886c9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782239955.687030:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239955.687136:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737972992 00000100:00100000:2.0:1782239955.687150:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737972992 00000100:00100000:2.0:1782239955.687238:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 112 00000100:00100000:2.0:1782239955.687252:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb60135ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+56:10527:x1868813737972992:12345-192.168.203.32@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1782239955.687321:0:5792:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1782239955.687790:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb60135ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+56:10527:x1868813737972992:12345-192.168.203.32@tcp:53:lhsmtool_posix.0 Request processed in 498us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239955.687799:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 112 00000100:00100000:0.0:1782239955.688998:0:11535:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5ffd6df80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11535:1868813758960512:192.168.203.32@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1782239955.708258:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239955.708406:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737973120 00000100:00100000:0.0:1782239955.708431:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737973120 00000100:00100000:0.0:1782239955.708510:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 113 00000100:00100000:0.0:1782239955.708522:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc08e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+55:10527:x1868813737973120:12345-192.168.203.32@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1782239955.708638:0:6611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602172a00/0x8c5345f1c1ec54ac lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239955.708661:0:6611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602172a00/0x8c5345f1c1ec54ac lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239955.708675:0:6611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602172a00/0x8c5345f1c1ec54ac lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239955.708954:0:6611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602172c00/0x8c5345f1c1ec54b3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239955.708978:0:6611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602172c00/0x8c5345f1c1ec54b3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239955.708992:0:6611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602172c00/0x8c5345f1c1ec54b3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239955.709022:0:6611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602173200/0x8c5345f1c1ec54ba lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239955.709048:0:6611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602173200/0x8c5345f1c1ec54ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239955.709055:0:6611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602173200/0x8c5345f1c1ec54ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782239955.709108:0:6611:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1782239955.709112:0:6611:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782239955.709125:0:6611:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602173200/0x8c5345f1c1ec54ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239955.709136:0:6611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602172a00/0x8c5345f1c1ec54ac lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239955.710135:0:6611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602172a00/0x8c5345f1c1ec54ac lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239955.710566:0:6611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602172a00/0x8c5345f1c1ec54ac lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239955.710573:0:6611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb602172a00 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:0.0:1782239955.710578:0:6611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602172a00/0x8c5345f1c1ec54ac lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239955.710588:0:6611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602172a00/0x8c5345f1c1ec54ac lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239955.710606:0:6611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bb5d0df4b00) 00010000:00010000:0.0:1782239955.710609:0:6611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782239955.710614:0:6611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602172a00/0x8c5345f1c1ec54ac lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239955.710639:0:6611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602172a00/0x8c5345f1c1ec54ac lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239955.710662:0:6611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602172c00/0x8c5345f1c1ec54b3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239955.710668:0:6611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602172c00/0x8c5345f1c1ec54b3 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239955.710675:0:6611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602172c00/0x8c5345f1c1ec54b3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239955.710680:0:6611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb602172c00 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:0.0:1782239955.710683:0:6611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602172c00/0x8c5345f1c1ec54b3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239955.710690:0:6611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602172c00/0x8c5345f1c1ec54b3 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239955.710698:0:6611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff9bb5c55de900) 00010000:00010000:0.0:1782239955.710700:0:6611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782239955.710703:0:6611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602172c00/0x8c5345f1c1ec54b3 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239955.710709:0:6611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602172c00/0x8c5345f1c1ec54b3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239955.710728:0:6611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602173200/0x8c5345f1c1ec54ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239955.710734:0:6611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602173200/0x8c5345f1c1ec54ba lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239955.711780:0:6611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602173200/0x8c5345f1c1ec54ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239955.711795:0:6611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb602173200 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:0.0:1782239955.711799:0:6611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602173200/0x8c5345f1c1ec54ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239955.711806:0:6611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602173200/0x8c5345f1c1ec54ba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239955.711818:0:6611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bb5d0df4300) 00010000:00010000:0.0:1782239955.711821:0:6611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782239955.711825:0:6611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602173200/0x8c5345f1c1ec54ba lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239955.711832:0:6611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602173200/0x8c5345f1c1ec54ba lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239955.715894:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc08e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+55:10527:x1868813737973120:12345-192.168.203.32@tcp:34:lhsmtool_posix.0 Request processed in 7361us (7646us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239955.715911:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 113 00000100:00100000:1.0:1782239955.723912:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239955.724633:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737973376 00000100:00100000:2.0:1782239955.724651:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737973376 00000100:00100000:2.0:1782239955.724782:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 114 00000100:00100000:2.0:1782239955.724795:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8eed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+55:10527:x1868813737973376:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782239955.724823:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782239955.724850:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fa00/0x8c5345f1c1ec54c1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e636 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239955.724984:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec54c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239955.725001:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec54c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239955.725014:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec54c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782239955.725027:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1782239955.725170:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec54c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239955.725179:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec54c8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239955.725186:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec54c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239955.725208:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5ee29ea00 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:2.0:1782239955.725214:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec54c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239955.725222:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec54c8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239955.725235:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bb5d0df4300) 00010000:00010000:2.0:1782239955.725238:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1782239955.725242:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec54c8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239955.725248:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec54c8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239955.725295:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fa00/0x8c5345f1c1ec54c1 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e636 expref: 57 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239955.725306:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bb5d0df4b00) 00010000:00010000:2.0:1782239955.725309:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782239955.725313:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fa00/0x8c5345f1c1ec54c1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e636 expref: 57 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239955.725322:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5ee29fa00, rc 0) 00000100:00100000:2.0:1782239955.725410:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8eed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+56:10527:x1868813737973376:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 618us (1512us total) trans 4294967397 rc 301/301 00000100:00100000:2.0:1782239955.725418:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 114 00000100:00100000:2.0:1782239955.732537:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239955.733054:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737973504 00000100:00100000:1.0:1782239955.733071:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737973504 00000100:00100000:1.0:1782239955.733164:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 115 00000100:00100000:1.0:1782239955.733177:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7c0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+56:10527:x1868813737973504:12345-192.168.203.32@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1782239955.733255:0:5791:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1782239955.733417:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7c0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+56:10527:x1868813737973504:12345-192.168.203.32@tcp:53:lhsmtool_posix.0 Request processed in 242us (898us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239955.733426:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 115 00000100:00100000:0.0:1782239955.738957:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239955.739066:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737973760 00000100:00100000:2.0:1782239955.739087:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737973760 00000100:00100000:2.0:1782239955.739166:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 116 00000100:00100000:2.0:1782239955.739177:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ffd6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+56:10527:x1868813737973760:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782239955.739205:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782239955.739209:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1782239955.739245:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fc00/0x8c5345f1c1ec5466 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e61a expref: 56 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239955.739270:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bb5c4ed6b00) 00010000:00010000:2.0:1782239955.739275:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782239955.739289:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fa00/0x8c5345f1c1ec54d6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e63d expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782239955.740193:0:5792:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:2.0:1782239955.740496:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec54dd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239955.740514:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec54dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239955.740525:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec54dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239955.740593:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fa00/0x8c5345f1c1ec54d6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e63d expref: 58 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239955.740613:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec54dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e63d expref: 57 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239955.740638:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9bb5c4ed6500) 00010000:00010000:2.0:1782239955.740642:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782239955.740645:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5ee29ea00, rc 0) 00000100:00100000:2.0:1782239955.740730:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ffd6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+57:10527:x1868813737973760:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 1555us (1789us total) trans 4294967398 rc 0/0 00000100:00100000:2.0:1782239955.740739:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 116 00000100:00100000:1.0:1782239955.755976:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239955.756042:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737974016 00000100:00100000:3.0:1782239955.756056:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737974016 00000100:00100000:3.0:1782239955.756147:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 117 00000100:00100000:3.0:1782239955.756160:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8eed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+57:10527:x1868813737974016:12345-192.168.203.32@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1782239955.756248:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782239955.756284:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec54dd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e63d expref: 57 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239955.756308:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9bb5c4ed6500) 00010000:00010000:3.0:1782239955.756322:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782239955.756741:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26800/0x8c5345f1c1ec54eb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239955.756793:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26800/0x8c5345f1c1ec54eb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239955.756826:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26800/0x8c5345f1c1ec54eb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239955.756844:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27600/0x8c5345f1c1ec54f2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x1012619 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239955.756850:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27600/0x8c5345f1c1ec54f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x1012619 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239955.756856:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27600/0x8c5345f1c1ec54f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x1012619 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239955.756969:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26800/0x8c5345f1c1ec54eb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239955.756978:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26800/0x8c5345f1c1ec54eb lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239955.756985:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26800/0x8c5345f1c1ec54eb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239955.756992:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f7e26800 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:3.0:1782239955.756996:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26800/0x8c5345f1c1ec54eb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239955.757005:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26800/0x8c5345f1c1ec54eb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239955.757014:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bb5c4ed6b00) 00010000:00010000:3.0:1782239955.757017:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782239955.757022:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26800/0x8c5345f1c1ec54eb lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239955.757038:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26800/0x8c5345f1c1ec54eb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239955.757050:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27600/0x8c5345f1c1ec54f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x1012619 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239955.757056:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27600/0x8c5345f1c1ec54f2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x1012619 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239955.757062:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27600/0x8c5345f1c1ec54f2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x1012619 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239955.757068:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f7e27600 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:3.0:1782239955.757071:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27600/0x8c5345f1c1ec54f2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x1012619 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239955.757086:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27600/0x8c5345f1c1ec54f2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x1012619 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239955.757095:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x1012619 (ffff9bb5d0df4c00) 00010000:00010000:3.0:1782239955.757098:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782239955.757101:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27600/0x8c5345f1c1ec54f2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x1012619 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239955.757107:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27600/0x8c5345f1c1ec54f2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x1012619 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239955.757220:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8eed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+56:10527:x1868813737974016:12345-192.168.203.32@tcp:36:lhsmtool_posix.0 Request processed in 1061us (1256us total) trans 0 rc -2/-2 00000100:00100000:3.0:1782239955.757230:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 117 00000100:00100000:2.0:1782239955.761804:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239955.761851:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737974144 00000100:00100000:2.0:1782239955.761864:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737974144 00000100:00100000:2.0:1782239955.762005:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 118 00000100:00100000:2.0:1782239955.762018:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7c0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+56:10527:x1868813737974144:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782239955.762045:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782239955.762170:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fa00/0x8c5345f1c1ec54f9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e644 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239955.762229:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fc00/0x8c5345f1c1ec5500 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239955.762248:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fc00/0x8c5345f1c1ec5500 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239955.762269:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fc00/0x8c5345f1c1ec5500 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239955.766695:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fa00/0x8c5345f1c1ec54f9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e644 expref: 58 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239955.766732:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fc00/0x8c5345f1c1ec5500 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e644 expref: 57 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239955.766744:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9bb5c4ed6400) 00010000:00010000:1.0:1782239955.766780:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1782239955.766799:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5ee29fc00, rc 0) 00000100:00100000:1.0:1782239955.766923:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7c0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+57:10527:x1868813737974144:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 4905us (5132us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239955.766933:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 118 00000100:00100000:1.0:1782239955.774611:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239955.775673:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737974400 00000100:00100000:3.0:1782239955.775691:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737974400 00000100:00100000:1.0:1782239955.775830:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 119 00000100:00100000:1.0:1782239955.775848:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fff03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+57:10527:x1868813737974400:12345-192.168.203.32@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1782239955.775973:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39200/0x8c5345f1c1ec5507 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239955.775997:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39200/0x8c5345f1c1ec5507 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239955.776012:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39200/0x8c5345f1c1ec5507 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782239955.776345:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:1.0:1782239955.776369:0:5791:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 334848619736ns, next at 335848616436ns, rc = 0 00000004:00010000:1.0:1782239955.776500:0:5791:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a2a367d6 reply state 00000000307870f4 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39200/0x8c5345f1c1ec5507 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239955.776511:0:5791:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782239955.776647:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fff03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+59:10527:x1868813737974400:12345-192.168.203.32@tcp:36:lhsmtool_posix.0 Request processed in 805us (2049us total) trans 4294967399 rc 0/0 00000100:00100000:1.0:1782239955.776656:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 119 00000100:00100000:3.0:1782239955.782346:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00010000:00010000:3.0:1782239955.782716:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39200/0x8c5345f1c1ec5507 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239955.782732:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39200/0x8c5345f1c1ec5507 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239955.782740:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39200/0x8c5345f1c1ec5507 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239955.782770:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f7e39200 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:3.0:1782239955.782775:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39200/0x8c5345f1c1ec5507 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239955.782784:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39200/0x8c5345f1c1ec5507 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239955.782807:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9bb5c4ed6400) 00010000:00010000:3.0:1782239955.782810:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1782239955.782816:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39200/0x8c5345f1c1ec5507 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239955.782823:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39200/0x8c5345f1c1ec5507 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239955.782858:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737974528 00000100:00100000:3.0:1782239955.782870:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737974528 00000100:00100000:3.0:1782239955.782931:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 120 00000100:00100000:3.0:1782239955.782941:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc08d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+58:10527:x1868813737974528:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782239955.782974:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782239955.783012:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27600/0x8c5345f1c1ec550e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e64b expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239955.783244:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27600/0x8c5345f1c1ec550e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e64b expref: 59 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239955.783261:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27600/0x8c5345f1c1ec550e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e64b expref: 59 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239955.783282:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9bb5c4ed6400) 00010000:00010000:3.0:1782239955.783285:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782239955.783288:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5f7e27600, rc 0) 00000100:00100000:3.0:1782239955.783590:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc08d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+59:10527:x1868813737974528:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 647us (1258us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239955.783599:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 120 00000100:00100000:1.0:1782239955.794728:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239955.794977:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737974656 00000100:00100000:3.0:1782239955.794993:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737974656 00000100:00100000:3.0:1782239955.795086:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 37 00000100:00100000:3.0:1782239955.795102:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fff00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+8:2344:x1868813737974656:12345-192.168.203.32@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1782239955.795649:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782239955.798585:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fff00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+9:2344:x1868813737974656:12345-192.168.203.32@tcp:2:lhsmtool_posix.0 Request processed in 3470us (3856us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1782239955.798605:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 37 00000100:00100000:3.0:1782239955.807973:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239955.808095:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737974912 00000100:00100000:2.0:1782239955.808111:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737974912 00000100:00100000:2.0:1782239955.808195:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 30 00000100:00100000:2.0:1782239955.808435:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc08ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+59:10527:x1868813737974912:12345-192.168.203.32@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1782239955.808907:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc08ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+60:10527:x1868813737974912:12345-192.168.203.32@tcp:35:lhsmtool_posix.0 Request processed in 474us (948us total) trans 4294967400 rc 0/0 00000100:00100000:3.0:1782239955.812938:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239955.812989:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737975168 00000100:00100000:3.0:1782239955.813002:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737975168 00000100:00100000:3.0:1782239955.813068:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 121 00000100:00100000:3.0:1782239955.813089:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc08fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+61:10527:x1868813737975168:12345-192.168.203.32@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1782239955.813252:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc08fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+61:10527:x1868813737975168:12345-192.168.203.32@tcp:57:lhsmtool_posix.0 Request processed in 165us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239955.813260:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 121 00000100:00100000:1.0:1782239955.819065:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239955.819138:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737975296 00000100:00100000:1.0:1782239955.819162:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737975296 00000100:00100000:1.0:1782239955.819239:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 122 00000100:00100000:1.0:1782239955.819252:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fff01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+61:10527:x1868813737975296:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782239955.819283:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782239955.819317:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38a00/0x8c5345f1c1ec5515 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e652 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239955.819420:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38c00/0x8c5345f1c1ec551c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239955.819438:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38c00/0x8c5345f1c1ec551c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239955.819460:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38c00/0x8c5345f1c1ec551c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782239955.819511:0:5790:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782239955.819534:0:5790:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38c00/0x8c5345f1c1ec551c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239955.819567:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38a00/0x8c5345f1c1ec5515 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e652 expref: 63 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239955.819589:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38c00/0x8c5345f1c1ec551c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e652 expref: 62 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239955.819600:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9bb5c4ed6400) 00010000:00010000:1.0:1782239955.819864:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1782239955.819871:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5f7e38c00, rc 0) 00000100:00100000:1.0:1782239955.820148:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fff01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+62:10527:x1868813737975296:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 895us (1095us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239955.820166:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 122 00000100:00100000:2.0:1782239955.820370:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 30 00000100:00100000:3.0:1782239955.828152:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239955.830603:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737975424 00000100:00100000:2.0:1782239955.830627:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737975424 00000100:00100000:2.0:1782239955.830727:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 38 00000100:00100000:2.0:1782239955.830741:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc08f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+9:2345:x1868813737975424:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782239955.830791:0:6590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782239955.830826:0:6590:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000084a1df51/0x8c5345f1c1ec5523 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e659 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782239955.830866:0:6590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a3ad2d3, blocks: 0x1 00010000:00010000:2.0:1782239955.830894:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=334s v=(0 0) 00010000:00010000:2.0:1782239955.830901:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782239955.830915:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000084a1df51/0x8c5345f1c1ec5523 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e659 expref: 10 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239955.830938:0:6590:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000084a1df51/0x8c5345f1c1ec5523 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e659 expref: 10 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239955.830958:0:6590:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5ee29e000, rc 0) 00000100:00100000:2.0:1782239955.831056:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc08f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+10:2345:x1868813737975424:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 318us (2924us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239955.831065:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 38 00000100:00100000:0.0:1782239955.843545:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239955.843827:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737975680 00000100:00100000:3.0:1782239955.843841:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737975680 00000100:00100000:3.0:1782239955.843923:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 123 00000100:00100000:3.0:1782239955.843935:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb6018ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+61:10527:x1868813737975680:12345-192.168.203.32@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1782239955.844095:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb6018ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+61:10527:x1868813737975680:12345-192.168.203.32@tcp:57:lhsmtool_posix.0 Request processed in 161us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239955.844104:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 123 00000100:00100000:3.0:1782239955.848188:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239955.848411:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737975808 00000100:00100000:1.0:1782239955.848426:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737975808 00000100:00100000:1.0:1782239955.848497:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 39 00000100:00100000:1.0:1782239955.848510:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc08e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+10:10527:x1868813737975808:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782239955.848535:0:6588:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782239955.848563:0:6588:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b818248f/0x8c5345f1c1ec552a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e660 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239955.848616:0:6588:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000084a1df51/0x8c5345f1c1ec5523 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e659 expref: 11 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239955.848626:0:6588:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782239955.848631:0:6588:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782239955.848636:0:6588:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b818248f/0x8c5345f1c1ec552a lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e660 expref: 11 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239955.848677:0:6588:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000084a1df51/0x8c5345f1c1ec5523 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e659 expref: 11 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239955.848693:0:6588:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000084a1df51/0x8c5345f1c1ec5523 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e659 expref: 11 pid: 6590 timeout: 434 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239955.848712:0:6588:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fff01880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6588:1868813758960640:192.168.203.32@tcp:104: 00000100:00100000:1.0:1782239955.848868:0:6588:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5f7cbd540 going to sleep for 11 seconds 00000100:00100000:3.0:1782239955.854010:0:6588:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fff01880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6588:1868813758960640:192.168.203.32@tcp:104: 00010000:00010000:3.0:1782239955.854062:0:6588:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b818248f/0x8c5345f1c1ec552a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e660 expref: 11 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239955.854100:0:6588:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5f7e38a00, rc 0) 00000100:00100000:3.0:1782239955.854173:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc08e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+11:10527:x1868813737975808:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 5664us (5998us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239955.854184:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 39 00000100:00100000:3.0:1782239955.854318:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239955.854415:0:7481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737975936 00000100:00100000:3.0:1782239955.854423:0:7481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737975936 00010000:00010000:3.0:1782239955.854457:0:7481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000084a1df51/0x8c5345f1c1ec5523 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e659 expref: 11 pid: 6590 timeout: 434 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239955.854504:0:7481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 53 00000100:00100000:3.0:1782239955.854515:0:7481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d021a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+11:2345:x1868813737975936:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782239955.854537:0:7481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782239955.854565:0:7481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000084a1df51/0x8c5345f1c1ec5523 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e659 expref: 11 pid: 6590 timeout: 434 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239955.854580:0:7481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000084a1df51/0x8c5345f1c1ec5523 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e659 expref: 11 pid: 6590 timeout: 434 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239955.854608:0:7481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000084a1df51/0x8c5345f1c1ec5523 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e659 expref: 11 pid: 6590 timeout: 434 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239955.854625:0:7481:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782239955.854629:0:7481:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782239955.854639:0:7481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b818248f/0x8c5345f1c1ec552a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e660 expref: 10 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239955.854651:0:7481:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b818248f/0x8c5345f1c1ec552a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e660 expref: 10 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239955.854697:0:7481:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000b818248f/0x8c5345f1c1ec552a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e660 expref: 10 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239955.854714:0:7481:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fc08ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7481:1868813758960768:192.168.203.32@tcp:105: 00000100:00100000:3.0:1782239955.854838:0:7481:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5f7b47780 going to sleep for 11 seconds 00000001:00080000:0.0:1782239955.860978:0:7493:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000001:00080000:0.0:1782239955.861005:0:7493:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00080000:0.0:1782239955.861017:0:7493:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00080000:0.0:1782239955.861023:0:7493:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:0.0:1782239955.871161:0:7481:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fc08ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7481:1868813758960768:192.168.203.32@tcp:105: 00010000:00010000:0.0:1782239955.871196:0:7481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782239955.871278:0:7481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d021a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+10:2345:x1868813737975936:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 16763us (16958us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239955.871293:0:7481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 53 00000100:00100000:1.0:1782239955.874034:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239955.874202:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737976064 00000100:00100000:3.0:1782239955.874216:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737976064 00002000:00100000:3.0:1782239955.874286:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9bb5fff02d80 x1868813737976064/t0(0) o4->36dd742b-25b8-431e-bf41-75f2fff47ffb@192.168.203.32@tcp:556/0 lens 504/0 e 0 to 0 dl 1782239966 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1782239955.874300:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9bb5fff02d80 with x1868813737976064 ext(0->12) 00002000:00010000:3.0:1782239955.874307:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bb5fff02d80 00000100:00100000:3.0:1782239955.874354:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 2 00000100:00100000:3.0:1782239955.874364:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fff02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+10:2345:x1868813737976064:12345-192.168.203.32@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1782239955.875184:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fff02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+12:2345:x1868813737976064:12345-192.168.203.32@tcp:4:lhsmtool_posix.0 Request processed in 812us (1156us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1782239955.875195:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 2 00002000:00100000:3.0:1782239955.875204:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9bb5fff02d80 x1868813737976064/t4294967308(0) o4->36dd742b-25b8-431e-bf41-75f2fff47ffb@192.168.203.32@tcp:556/0 lens 504/448 e 0 to 0 dl 1782239966 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1782239955.875214:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9bb5fff02d80 with x1868813737976064 ext(0->12) 00002000:00010000:3.0:1782239955.875219:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bb5fff02d80 00000100:00100000:2.0:1782239955.883060:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239955.883196:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737976192 00000100:00100000:1.0:1782239955.883211:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737976192 00000100:00100000:1.0:1782239955.883297:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 124 00000100:00100000:1.0:1782239955.883312:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7c0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+61:10527:x1868813737976192:12345-192.168.203.32@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1782239955.959219:0:5812:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967364 is committed 00000001:00080000:3.0:1782239955.959248:0:5812:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967399 is committed 00000004:00080000:3.0:1782239955.959254:0:5812:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:3.0:1782239955.959296:0:5812:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bb5f7cbd480 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:3.0:1782239955.959302:0:5812:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9bb5c9b29d00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bb5f7cbd600 00000020:00080000:3.0:1782239955.959306:0:5812:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9bb5c9b29200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bb5ee2d9400 00000001:00080000:3.0:1782239955.959327:0:5812:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:3.0:1782239955.959361:0:5812:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000004:00080000:3.0:1782239955.959420:0:5812:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:3.0:1782239955.959441:0:5812:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bb5f7b473c0 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:1.0:1782239955.959538:0:5823:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 2 committed batchid 1 00000020:00080000:1.0:1782239955.959865:0:5823:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:3.0:1782239955.960305:0:5812:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9bb5ee1d0100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bb5f7b47480 00000020:00080000:3.0:1782239955.960309:0:5812:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9bb5ee1d0e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bb5f7ebb400 00000020:00080000:0.0:1782239955.960406:0:5823:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:0.0:1782239955.960438:0:5823:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1782239955.960642:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f780ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1868813758961024:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1782239955.960734:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239955.960974:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5c513c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1868813758960896:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782239955.961010:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239955.961053:0:8312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758961024 00000100:00100000:1.0:1782239955.961062:0:8312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758961024 00000100:00100000:1.0:1782239955.961139:0:8312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758960896 00000100:00100000:1.0:1782239955.961143:0:8312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758960896 00000100:00100000:1.0:1782239955.961167:0:8312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1782239955.961177:0:8312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc08f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3304:x1868813758961024:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1782239955.961441:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782239955.961514:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fc08d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1868813758961152:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1782239955.961547:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239955.961649:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758961152 00000100:00100000:0.0:1782239955.961653:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758961152 00000100:00100000:0.0:1782239955.961678:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1782239955.961685:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fff03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3307:x1868813758960896:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1782239955.961705:0:6590:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:0.0:1782239955.961735:0:6590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076dbc825/0x8c5345f1c1ec5531 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239955.961783:0:6590:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003cf745fe/0x8c5345f1c1ec52f3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e5bf expref: 11 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239955.961794:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1782239955.961799:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782239955.961804:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076dbc825/0x8c5345f1c1ec5531 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239955.962005:0:6590:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003cf745fe/0x8c5345f1c1ec52f3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e5bf expref: 11 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239955.962024:0:6590:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003cf745fe/0x8c5345f1c1ec52f3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e5bf expref: 11 pid: 6590 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782239955.962039:0:6590:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f7e63480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6590:1868813758961280:192.168.203.32@tcp:104: 00000100:00100000:0.0:1782239955.962135:0:6590:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c886c000 going to sleep for 11 seconds 00002000:00010000:1.0:1782239955.962692:0:8312:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1782239955.962697:0:8312:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1782239955 00002000:00010000:1.0:1782239955.962700:0:8312:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1782239955.962703:0:8312:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1782239955 -> 1782239955 00002000:00010000:1.0:1782239955.962705:0:8312:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1782239955.962784:0:8312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc08f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3304:x1868813758961024:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1607us (2050us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1782239955.962793:0:8312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1782239955.962965:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7c0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+15:10527:x1868813737976192:12345-192.168.203.32@tcp:44:lhsmtool_posix.0 Request processed in 79655us (79921us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239955.962977:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 124 00000004:00080000:0.0:1782239955.963152:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bb5f780ea00/2, rc 0, transno 4294967309 00000100:00100000:0.0:1782239955.963179:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f780ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1868813758961024:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1782239955.964591:0:8312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1782239955.964612:0:8312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc08df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1868813758961152:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1782239955.964658:0:8312:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:1.0:1782239955.964701:0:8312:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a3ad2d2, atime: 0x6a3ad2d2, ctime: 0x6a3ad2d2, blocks: 0xb 00010000:00010000:1.0:1782239955.964729:0:8312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007cdebcfd/0x8c5345f1c1ec5538 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239955.964778:0:8312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=335s v=(0 0) 00010000:00010000:1.0:1782239955.964783:0:8312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782239955.964790:0:8312:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007cdebcfd/0x8c5345f1c1ec5538 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239955.966359:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239955.966422:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737976320 00000100:00100000:3.0:1782239955.966433:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737976320 00010000:00010000:1.0:1782239955.966536:0:8312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007cdebcfd/0x8c5345f1c1ec5538 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239955.966559:0:8312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007cdebcfd/0x8c5345f1c1ec5538 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239955.966568:0:8312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007cdebcfd/0x8c5345f1c1ec5538 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239955.966591:0:8312:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:2.0:1782239955.966944:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782239955.967040:0:6590:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f7e63480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6590:1868813758961280:192.168.203.32@tcp:104: 00010000:00010000:0.0:1782239955.967070:0:6590:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000076dbc825/0x8c5345f1c1ec5531 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239955.967622:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003cf745fe/0x8c5345f1c1ec52f3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e5bf expref: 12 pid: 6590 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239955.967684:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 54 00000100:00100000:1.0:1782239955.970355:0:8312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc08df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3304:x1868813758961152:12345-0@lo:6:osp-syn-1-0.0 Request processed in 5726us (8781us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1782239955.970373:0:8312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00010000:1.0:1782239955.970428:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782239955.970438:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007cdebcfd/0x8c5345f1c1ec5538 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239955.970652:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f7e38e00 already unused, calling callback (ffffffffc1728ce0) 00010000:00010000:1.0:1782239955.970658:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007cdebcfd/0x8c5345f1c1ec5538 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239955.970686:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007cdebcfd/0x8c5345f1c1ec5538 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239955.970713:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007cdebcfd/0x8c5345f1c1ec5538 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239955.970721:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007cdebcfd/0x8c5345f1c1ec5538 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239955.971988:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782239955.971995:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782239955.971998:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782239955.972189:0:3304:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:0.0:1782239955.972199:0:3304:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967303 00000004:00080000:0.0:1782239955.972226:0:3304:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bb5e8eeca80, transno 4294967301 00000004:00080000:0.0:1782239955.972256:0:3304:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967303 00000100:00100000:0.0:1782239955.972274:0:3304:0:(client.c:3155:ptlrpc_free_committed()) @@@ stopping search req@ffff9bb5fc08d880 x1868813758961152/t4294967304(4294967304) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1782239971 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1782239955.972288:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bb5fc08d880/2, rc 0, transno 4294967304 00000100:00100000:0.0:1782239955.972294:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fc08d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1868813758961152:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782239955.974526:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239955.974584:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737976448 00000100:00100000:0.0:1782239955.974602:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737976448 00000100:00100000:3.0:1782239955.978706:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc08f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+13:2344:x1868813737976320:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782239955.978775:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782239955.978791:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003cf745fe/0x8c5345f1c1ec52f3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e5bf expref: 13 pid: 6590 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239955.978829:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003cf745fe/0x8c5345f1c1ec52f3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e5bf expref: 13 pid: 6590 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239955.980311:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003cf745fe/0x8c5345f1c1ec52f3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e5bf expref: 13 pid: 6590 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239955.980380:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782239955.980385:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782239955.980393:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000076dbc825/0x8c5345f1c1ec5531 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239955.980404:0:5777:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076dbc825/0x8c5345f1c1ec5531 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239955.980460:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782239955.980542:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc08f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+12:2344:x1868813737976320:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 12844us (14196us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239955.980556:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 54 00010000:00010000:1.0:1782239955.980784:0:6590:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000076dbc825/0x8c5345f1c1ec5531 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239955.980798:0:6590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076dbc825/0x8c5345f1c1ec5531 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239955.980820:0:6590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076dbc825/0x8c5345f1c1ec5531 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239955.980828:0:6590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000076dbc825/0x8c5345f1c1ec5531 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239955.980852:0:6590:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1782239955.981818:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fff03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3307:x1868813758960896:12345-0@lo:6:osp-syn-0-0.0 Request processed in 20127us (20801us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1782239955.981829:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000004:00080000:1.0:1782239955.981916:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bb5c513c380/2, rc 0, transno 4294967310 00000100:00100000:1.0:1782239955.981924:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5c513c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1868813758960896:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1782239955.982977:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782239955.982990:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000076dbc825/0x8c5345f1c1ec5531 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239955.983006:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb602172c00 already unused, calling callback (ffffffffc1728ce0) 00010000:00010000:3.0:1782239955.983013:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000076dbc825/0x8c5345f1c1ec5531 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239955.983026:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000076dbc825/0x8c5345f1c1ec5531 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239955.983050:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000076dbc825/0x8c5345f1c1ec5531 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239955.983090:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076dbc825/0x8c5345f1c1ec5531 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239955.983121:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782239955.983123:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782239955.983126:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782239955.983519:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 43 00000100:00100000:0.0:1782239955.983534:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7e63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+11:2345:x1868813737976448:12345-192.168.203.32@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1782239956.116093:0:6614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:0.0:1782239956.116125:0:6614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:0.0:1782239956.116440:0:6614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000001:00080000:0.0:1782239956.116519:0:6614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:1.0:1782239956.117146:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7e63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+6:2345:x1868813737976448:12345-192.168.203.32@tcp:16:lhsmtool_posix.0 Request processed in 133605us (142629us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239956.117163:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 43 00000100:00100000:0.0:1782239956.120335:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239956.120606:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737976704 00000100:00100000:3.0:1782239956.120621:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737976704 00000100:00100000:3.0:1782239956.120699:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 125 00000100:00100000:3.0:1782239956.120711:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ffd6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+15:10527:x1868813737976704:12345-192.168.203.32@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1782239956.120938:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782239956.120978:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38c00/0x8c5345f1c1ec551c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e652 expref: 15 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239956.121004:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9bb5c4ed6400) 00010000:00010000:3.0:1782239956.121011:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782239956.121049:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26c00/0x8c5345f1c1ec553f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239956.121066:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26c00/0x8c5345f1c1ec553f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239956.124913:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26c00/0x8c5345f1c1ec553f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782239956.125298:0:5791:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000636f8ae7 reply state 0000000017518eb5 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26c00/0x8c5345f1c1ec553f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239956.125335:0:5791:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782239956.125803:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ffd6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+16:10527:x1868813737976704:12345-192.168.203.32@tcp:36:lhsmtool_posix.0 Request processed in 5089us (5480us total) trans 4294967401 rc 0/0 00000100:00100000:3.0:1782239956.125814:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 125 00010000:00010000:1.0:1782239956.129043:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26c00/0x8c5345f1c1ec553f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239956.129068:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26c00/0x8c5345f1c1ec553f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239956.129086:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26c00/0x8c5345f1c1ec553f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239956.129093:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f7e26c00 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:1.0:1782239956.129099:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26c00/0x8c5345f1c1ec553f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239956.129109:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26c00/0x8c5345f1c1ec553f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239956.129135:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9bb5c4ed6400) 00010000:00010000:1.0:1782239956.129138:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782239956.129144:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26c00/0x8c5345f1c1ec553f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239956.129151:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26c00/0x8c5345f1c1ec553f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782239956.130039:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239956.130130:0:8312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737976832 00000100:00100000:1.0:1782239956.130143:0:8312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737976832 00000100:00100000:1.0:1782239956.130218:0:8312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 44 00000100:00100000:1.0:1782239956.130229:0:8312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f779ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+6:2344:x1868813737976832:12345-192.168.203.32@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1782239956.130574:0:8312:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1782239956.130578:0:8312:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1782239955 -> 1782239955 00002000:00010000:1.0:1782239956.130580:0:8312:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1782239954 00002000:00010000:1.0:1782239956.130582:0:8312:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1782239955 -> 1782239955 00002000:00010000:1.0:1782239956.130584:0:8312:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1782239956.130670:0:8312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f779ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+7:2344:x1868813737976832:12345-192.168.203.32@tcp:2:lhsmtool_posix.0 Request processed in 440us (639us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1782239956.130679:0:8312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 44 00000100:00100000:0.0:1782239956.133709:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239956.133939:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737977088 00000100:00100000:3.0:1782239956.133951:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737977088 00000100:00100000:3.0:1782239956.134028:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 126 00000100:00100000:3.0:1782239956.134042:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f779f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+15:10527:x1868813737977088:12345-192.168.203.32@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1782239956.134148:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26800/0x8c5345f1c1ec5546 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239956.134171:0:5790:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fc00/0x8c5345f1c1ec5500 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e644 expref: 15 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239956.134182:0:5790:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26800/0x8c5345f1c1ec5546 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239956.134227:0:5790:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fc00/0x8c5345f1c1ec5500 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e644 expref: 15 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239956.134242:0:5790:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fc00/0x8c5345f1c1ec5500 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e644 expref: 15 pid: 5792 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239956.134260:0:5790:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fc08ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5790:1868813758961408:192.168.203.32@tcp:104: 00000100:00100000:3.0:1782239956.134707:0:5790:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c7f88e40 going to sleep for 11 seconds 00000100:00100000:2.0:1782239956.142179:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239956.142483:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737977216 00000100:00100000:1.0:1782239956.142497:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737977216 00010000:00010000:1.0:1782239956.142564:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fc00/0x8c5345f1c1ec5500 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e644 expref: 16 pid: 5792 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239956.142615:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 55 00000100:00100000:1.0:1782239956.142628:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7c0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+16:2345:x1868813737977216:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782239956.142648:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782239956.142656:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fc00/0x8c5345f1c1ec5500 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e644 expref: 16 pid: 5792 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239956.142671:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fc00/0x8c5345f1c1ec5500 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e644 expref: 16 pid: 5792 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239956.142726:0:5775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9bb5c4ed6400) 00010000:00010000:1.0:1782239956.142732:0:5775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26800/0x8c5345f1c1ec5546 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239956.142743:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26800/0x8c5345f1c1ec5546 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239956.142786:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26800/0x8c5345f1c1ec5546 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239956.142821:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782239956.143186:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7c0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+16:2345:x1868813737977216:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 559us (1021us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239956.143197:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 55 00010000:00010000:3.0:1782239956.151921:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fc00/0x8c5345f1c1ec5500 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e644 expref: 15 pid: 5792 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239956.151988:0:5790:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fc08ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5790:1868813758961408:192.168.203.32@tcp:104: 00010000:00010000:3.0:1782239956.152021:0:5790:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26800/0x8c5345f1c1ec5546 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239956.152034:0:5790:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26800/0x8c5345f1c1ec5546 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239956.152041:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26800/0x8c5345f1c1ec5546 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239956.152092:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26800/0x8c5345f1c1ec5546 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239956.152100:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26800/0x8c5345f1c1ec5546 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239956.152107:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26800/0x8c5345f1c1ec5546 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239956.152114:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f7e26800 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:3.0:1782239956.152119:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26800/0x8c5345f1c1ec5546 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239956.152127:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26800/0x8c5345f1c1ec5546 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239956.152147:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9bb5c4ed6400) 00010000:00010000:3.0:1782239956.152151:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1782239956.152156:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26800/0x8c5345f1c1ec5546 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239956.152170:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26800/0x8c5345f1c1ec5546 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239956.152294:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f779f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+14:10527:x1868813737977088:12345-192.168.203.32@tcp:55:lhsmtool_posix.0 Request processed in 18254us (18597us total) trans 0 rc -22/-22 00000100:00100000:3.0:1782239956.152306:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 126 00000100:00100000:1.0:1782239956.157452:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239956.157979:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737977344 00000100:00100000:3.0:1782239956.157995:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737977344 00000100:00100000:3.0:1782239956.158086:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 45 00000100:00100000:3.0:1782239956.158099:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fff01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+7:2344:x1868813737977344:12345-192.168.203.32@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1782239956.158165:0:6589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c299336c/0x8c5345f1c1ec554d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239956.158194:0:6589:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b818248f/0x8c5345f1c1ec552a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e660 expref: 7 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239956.158205:0:6589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1782239956.158209:0:6589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782239956.158214:0:6589:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c299336c/0x8c5345f1c1ec554d lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239956.158259:0:6589:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b818248f/0x8c5345f1c1ec552a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e660 expref: 7 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239956.158275:0:6589:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b818248f/0x8c5345f1c1ec552a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e660 expref: 7 pid: 6588 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239956.158315:0:6589:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fc08ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6589:1868813758961536:192.168.203.32@tcp:104: 00000100:00100000:3.0:1782239956.161098:0:6589:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c7f88e40 going to sleep for 11 seconds 00000100:00100000:2.0:1782239956.167662:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239956.167794:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737977472 00000100:00100000:0.0:1782239956.167829:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737977472 00010000:00010000:0.0:1782239956.167892:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b818248f/0x8c5345f1c1ec552a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e660 expref: 8 pid: 6588 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782239956.167952:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 56 00000100:00100000:0.0:1782239956.167964:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5dee24380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+8:2347:x1868813737977472:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782239956.167984:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782239956.168016:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b818248f/0x8c5345f1c1ec552a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e660 expref: 8 pid: 6588 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239956.168036:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b818248f/0x8c5345f1c1ec552a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e660 expref: 8 pid: 6588 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239956.168085:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782239956.168091:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782239956.168100:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c299336c/0x8c5345f1c1ec554d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239956.168111:0:5776:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c299336c/0x8c5345f1c1ec554d lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239956.168135:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782239956.168208:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5dee24380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+8:2347:x1868813737977472:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 246us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239956.168215:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 56 00010000:00010000:3.0:1782239956.168490:0:6589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b818248f/0x8c5345f1c1ec552a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e660 expref: 7 pid: 6588 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239956.168508:0:6589:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fc08ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6589:1868813758961536:192.168.203.32@tcp:104: 00010000:00010000:3.0:1782239956.168532:0:6589:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c299336c/0x8c5345f1c1ec554d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239956.168553:0:6589:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c299336c/0x8c5345f1c1ec554d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239956.168561:0:6589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c299336c/0x8c5345f1c1ec554d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239956.168595:0:6589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c299336c/0x8c5345f1c1ec554d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239956.168604:0:6589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c299336c/0x8c5345f1c1ec554d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239956.168616:0:6589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c299336c/0x8c5345f1c1ec554d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239956.168650:0:6589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f7e27800 already unused, calling callback (ffffffffc1728ce0) 00010000:00010000:3.0:1782239956.168655:0:6589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c299336c/0x8c5345f1c1ec554d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239956.168665:0:6589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c299336c/0x8c5345f1c1ec554d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239956.168685:0:6589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c299336c/0x8c5345f1c1ec554d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239956.168693:0:6589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c299336c/0x8c5345f1c1ec554d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239956.168811:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fff01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+6:2344:x1868813737977344:12345-192.168.203.32@tcp:1:lhsmtool_posix.0 Request processed in 10654us (11322us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239956.168821:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 45 00000100:00100000:0.0:1782239956.170936:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239956.171086:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737977728 00000100:00100000:3.0:1782239956.171097:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737977728 00000100:00100000:3.0:1782239956.171173:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 127 00000100:00100000:3.0:1782239956.171185:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f779ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+14:10527:x1868813737977728:12345-192.168.203.32@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1782239956.171288:0:6611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26800/0x8c5345f1c1ec5554 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239956.171310:0:6611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26800/0x8c5345f1c1ec5554 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239956.171356:0:6611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26800/0x8c5345f1c1ec5554 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239956.171689:0:6611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27200/0x8c5345f1c1ec555b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239956.171702:0:6611:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27600/0x8c5345f1c1ec550e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e64b expref: 15 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239956.171710:0:6611:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27200/0x8c5345f1c1ec555b lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239956.171800:0:6611:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27600/0x8c5345f1c1ec550e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e64b expref: 15 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239956.171817:0:6611:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27600/0x8c5345f1c1ec550e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e64b expref: 15 pid: 5790 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239956.171836:0:6611:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fc08ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6611:1868813758961664:192.168.203.32@tcp:104: 00000100:00100000:3.0:1782239956.172045:0:6611:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c7f88e40 going to sleep for 11 seconds 00000100:00100000:2.0:1782239956.177941:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239956.178130:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737977856 00000100:00100000:1.0:1782239956.178144:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737977856 00010000:00010000:1.0:1782239956.178197:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27600/0x8c5345f1c1ec550e lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e64b expref: 16 pid: 5790 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239956.178245:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 57 00000100:00100000:1.0:1782239956.178547:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5dee24000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+16:2344:x1868813737977856:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782239956.178570:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782239956.178579:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27600/0x8c5345f1c1ec550e lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e64b expref: 16 pid: 5790 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239956.178595:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27600/0x8c5345f1c1ec550e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e64b expref: 16 pid: 5790 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239956.178661:0:5775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9bb5c4ed6400) 00010000:00010000:1.0:1782239956.178667:0:5775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27200/0x8c5345f1c1ec555b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239956.178679:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27200/0x8c5345f1c1ec555b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239956.178687:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27200/0x8c5345f1c1ec555b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239956.178713:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782239956.178824:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5dee24000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+16:2344:x1868813737977856:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 568us (897us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239956.178833:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 57 00010000:00010000:0.0:1782239956.180119:0:6611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27600/0x8c5345f1c1ec550e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e64b expref: 15 pid: 5790 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782239956.180169:0:6611:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fc08ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6611:1868813758961664:192.168.203.32@tcp:104: 00010000:00010000:0.0:1782239956.180202:0:6611:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27200/0x8c5345f1c1ec555b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239956.180213:0:6611:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27200/0x8c5345f1c1ec555b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239956.180219:0:6611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27200/0x8c5345f1c1ec555b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782239956.180508:0:6611:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:0.0:1782239956.180957:0:6611:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:0.0:1782239956.181015:0:6611:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:0.0:1782239956.181144:0:6611:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5ded64700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6611:1868813758961792:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1782239956.181239:0:6611:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239956.181279:0:6611:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c886c000 going to sleep for 11 seconds 00000100:00100000:3.0:1782239956.181660:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758961792 00000100:00100000:3.0:1782239956.181671:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758961792 00000100:00100000:3.0:1782239956.181736:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1782239956.181771:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ded66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6611:x1868813758961792:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1782239956.182024:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ded66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6611:x1868813758961792:12345-0@lo:1000:mdt00_003.0 Request processed in 277us (785us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239956.182034:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1782239956.182108:0:6611:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:3.0:1782239956.182115:0:6611:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967310 00000004:00080000:3.0:1782239956.182137:0:6611:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bb5f780ea00, transno 4294967309 00000004:00080000:3.0:1782239956.182147:0:6611:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bb5c513c380, transno 4294967310 00000100:00100000:3.0:1782239956.182154:0:6611:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5ded64700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6611:1868813758961792:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1782239956.188043:0:6611:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:2.0:1782239956.188177:0:6611:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5dee25500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6611:1868813758961920:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1782239956.188271:0:6611:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239956.188320:0:6611:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c2ed20c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782239956.189000:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758961920 00000100:00100000:3.0:1782239956.189014:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758961920 00000100:00100000:3.0:1782239956.189095:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1782239956.189108:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5dee27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6611:x1868813758961920:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1782239956.189805:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5dee27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6611:x1868813758961920:12345-0@lo:1000:mdt00_003.0 Request processed in 641us (1476us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1782239956.189822:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1782239956.191101:0:6611:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5dee25500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6611:1868813758961920:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1782239956.191427:0:6611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27200/0x8c5345f1c1ec555b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239956.191450:0:6611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27200/0x8c5345f1c1ec555b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239956.191459:0:6611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27200/0x8c5345f1c1ec555b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239956.191466:0:6611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f7e27200 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:2.0:1782239956.191472:0:6611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27200/0x8c5345f1c1ec555b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239956.191480:0:6611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27200/0x8c5345f1c1ec555b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239956.191498:0:6611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9bb5c4ed6400) 00010000:00010000:2.0:1782239956.191523:0:6611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782239956.191530:0:6611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27200/0x8c5345f1c1ec555b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239956.191548:0:6611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27200/0x8c5345f1c1ec555b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239956.191593:0:6611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27a00/0x8c5345f1c1ec549e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239956.191601:0:6611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27a00/0x8c5345f1c1ec549e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239956.191613:0:6611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27a00/0x8c5345f1c1ec549e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239956.191619:0:6611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f7e27a00 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:2.0:1782239956.191630:0:6611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27a00/0x8c5345f1c1ec549e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239956.191636:0:6611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27a00/0x8c5345f1c1ec549e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239956.191645:0:6611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bb5d0df4300) 00010000:00010000:2.0:1782239956.191648:0:6611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782239956.191656:0:6611:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602173800/0x8c5345f1c1ec54a5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e62f expref: 18 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239956.191669:0:6611:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602173800/0x8c5345f1c1ec54a5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e62f expref: 18 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239956.191680:0:6611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602173800/0x8c5345f1c1ec54a5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e62f expref: 18 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239956.191736:0:6611:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602173800/0x8c5345f1c1ec54a5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e62f expref: 18 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239956.191800:0:6611:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5dee26a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6611:1868813758962048:192.168.203.32@tcp:105: 00000100:00100000:2.0:1782239956.192437:0:6611:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c2ed20c0 going to sleep for 11 seconds 00010000:00010000:1.0:1782239956.193460:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782239956.196881:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239956.197013:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737977984 00000100:00100000:3.0:1782239956.197026:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737977984 00000100:00100000:3.0:1782239956.197105:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 31 00000100:00100000:3.0:1782239956.197118:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5dee24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+19:10526:x1868813737977984:12345-192.168.203.32@tcp:49:lfs.0 00000100:00100000:3.0:1782239956.197288:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5dee24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+19:10526:x1868813737977984:12345-192.168.203.32@tcp:49:lfs.0 Request processed in 172us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239956.197297:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 31 00000100:00100000:3.0:1782239956.199985:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239956.200261:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737978240 00000100:00100000:2.0:1782239956.200273:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737978240 00000100:00100000:2.0:1782239956.200359:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 128 00000100:00100000:2.0:1782239956.200372:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc08ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+19:10526:x1868813737978240:12345-192.168.203.32@tcp:58:lfs.0 00000040:00080000:2.0:1782239956.201259:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:2.0:1782239956.201386:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc08ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+19:10526:x1868813737978240:12345-192.168.203.32@tcp:58:lfs.0 Request processed in 1015us (1414us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239956.201397:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 128 00000100:00100000:0.0:1782239956.203876:0:6611:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5dee26a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6611:1868813758962048:192.168.203.32@tcp:105: 00010000:00010000:0.0:1782239956.204038:0:6611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27a00/0x8c5345f1c1ec549e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239956.204053:0:6611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27a00/0x8c5345f1c1ec549e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239956.204115:0:6611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602173200/0x8c5345f1c1ec5562 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239956.204133:0:6611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602173200/0x8c5345f1c1ec5562 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239956.204171:0:6611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602173200/0x8c5345f1c1ec5562 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239956.204184:0:6611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602173200/0x8c5345f1c1ec5562 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239956.204191:0:6611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602173200/0x8c5345f1c1ec5562 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239956.204198:0:6611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602173200/0x8c5345f1c1ec5562 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239956.204204:0:6611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb602173200 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:0.0:1782239956.204209:0:6611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602173200/0x8c5345f1c1ec5562 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239956.204216:0:6611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602173200/0x8c5345f1c1ec5562 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239956.204229:0:6611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bb5d0df4300) 00010000:00010000:0.0:1782239956.204232:0:6611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782239956.204236:0:6611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602173200/0x8c5345f1c1ec5562 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239956.204241:0:6611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602173200/0x8c5345f1c1ec5562 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239956.204253:0:6611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26800/0x8c5345f1c1ec5554 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239956.204260:0:6611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26800/0x8c5345f1c1ec5554 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239956.204272:0:6611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26800/0x8c5345f1c1ec5554 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239956.204276:0:6611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f7e26800 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:0.0:1782239956.204279:0:6611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26800/0x8c5345f1c1ec5554 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239956.204286:0:6611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26800/0x8c5345f1c1ec5554 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239956.204295:0:6611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bb5d0df4300) 00010000:00010000:0.0:1782239956.204297:0:6611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1782239956.204300:0:6611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26800/0x8c5345f1c1ec5554 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239956.204306:0:6611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26800/0x8c5345f1c1ec5554 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782239956.204849:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f779ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+18:10527:x1868813737977728:12345-192.168.203.32@tcp:57:lhsmtool_posix.0 Request processed in 33664us (33923us total) trans 4294967406 rc 0/0 00000100:00100000:0.0:1782239956.205178:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 127 00000020:00080000:0.0:1782239956.205186:0:6611:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1782239956.216221:0:11535:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1782239956.216236:0:11535:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1782239956.216308:0:11535:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1782239956.216319:0:11535:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1782239956.216704:0:11535:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5dee26300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11535:1868813758962176:192.168.203.32@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1782239956.217197:0:11535:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c2ed2d80 going to sleep for 11 seconds 00000100:00100000:3.0:1782239956.226490:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239956.227252:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737978496 00000100:00100000:0.0:1782239956.227267:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737978496 00000100:00100000:0.0:1782239956.227354:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 32 00000100:00100000:0.0:1782239956.227368:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5c779ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+19:10527:x1868813737978496:12345-192.168.203.32@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1782239956.229325:0:5794:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1782239956.229597:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:3.0:1782239956.229691:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27000/0x8c5345f1c1ec5569 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239956.229714:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27000/0x8c5345f1c1ec5569 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239956.229740:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27000/0x8c5345f1c1ec5569 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239956.230710:0:5794:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27000/0x8c5345f1c1ec5569 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239956.230728:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27000/0x8c5345f1c1ec5569 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239956.230735:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27000/0x8c5345f1c1ec5569 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239956.231367:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1782239956.231724:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5c779ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+21:10527:x1868813737978496:12345-192.168.203.32@tcp:35:lhsmtool_posix.0 Request processed in 4351us (5241us total) trans 4294967408 rc 0/0 00000100:00100000:3.0:1782239956.231739:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 32 00000020:00080000:3.0:1782239956.231747:0:5794:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1782239956.231948:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782239956.231960:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27000/0x8c5345f1c1ec5569 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239956.231975:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f7e27000 already unused, calling callback (ffffffffc1728ce0) 00010000:00010000:2.0:1782239956.231982:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27000/0x8c5345f1c1ec5569 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239956.232014:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27000/0x8c5345f1c1ec5569 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239956.232038:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9bb5d0df4900) 00010000:00010000:2.0:1782239956.232041:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1782239956.232048:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27000/0x8c5345f1c1ec5569 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239956.232057:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27000/0x8c5345f1c1ec5569 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239956.232095:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782239956.232098:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782239956.232102:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782239956.243817:0:11535:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5dee26300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11535:1868813758962176:192.168.203.32@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1782239956.251036:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239956.251531:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737978624 00000100:00100000:3.0:1782239956.251555:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737978624 00000100:00100000:3.0:1782239956.251630:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 129 00000100:00100000:3.0:1782239956.251645:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f780ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+20:10531:x1868813737978624:12345-192.168.203.32@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1782239956.251698:0:5791:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1782239956.251895:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f780ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+20:10531:x1868813737978624:12345-192.168.203.32@tcp:53:lhsmtool_posix.0 Request processed in 253us (874us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239956.252242:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 129 00000100:00100000:2.0:1782239956.261477:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239956.261519:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239956.261738:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737978880 00000100:00100000:3.0:1782239956.261791:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737978880 00000100:00100000:3.0:1782239956.261858:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737979008 00000100:00100000:3.0:1782239956.261879:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737979008 00000100:00100000:3.0:1782239956.261920:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 130 00000100:00100000:3.0:1782239956.261931:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5dee26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+21:10531:x1868813737978880:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782239956.261960:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782239956.261985:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27800/0x8c5345f1c1ec5570 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e667 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782239956.262022:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 131 00000100:00100000:0.0:1782239956.262039:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5dee24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+22:10529:x1868813737979008:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:0.0:1782239956.262059:0:6611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782239956.262081:0:6611:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602173200/0x8c5345f1c1ec5577 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e66e expref: -99 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239956.262128:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26200/0x8c5345f1c1ec557e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239956.262135:0:6611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602173600/0x8c5345f1c1ec5585 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239956.262146:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26200/0x8c5345f1c1ec557e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239956.262149:0:6611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602173600/0x8c5345f1c1ec5585 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239956.262170:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26200/0x8c5345f1c1ec557e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239956.262170:0:6611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602173600/0x8c5345f1c1ec5585 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782239956.262194:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1782239956.262195:0:6611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602172c00/0x8c5345f1c1ec558c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239956.262205:0:6611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602172c00/0x8c5345f1c1ec558c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239956.262211:0:6611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602172c00/0x8c5345f1c1ec558c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239956.262381:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27800/0x8c5345f1c1ec5570 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e667 expref: 25 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239956.262401:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26200/0x8c5345f1c1ec557e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e667 expref: 24 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239956.262411:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bb5d0df4300) 00010000:00010000:3.0:1782239956.262414:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1782239956.262418:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5f7e26200, rc 0) 00000100:00100000:3.0:1782239956.263027:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5dee26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+24:10531:x1868813737978880:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 1091us (1558us total) trans 4294967409 rc 0/0 00000100:00100000:3.0:1782239956.263038:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 130 00010000:00010000:0.0:1782239956.263291:0:6611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602172a00/0x8c5345f1c1ec559a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239956.263308:0:6611:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e400/0x8c5345f1c1ec5490 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e628 expref: 23 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239956.263318:0:6611:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602172a00/0x8c5345f1c1ec559a lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239956.263364:0:6611:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e400/0x8c5345f1c1ec5490 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e628 expref: 23 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239956.264935:0:6611:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e400/0x8c5345f1c1ec5490 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e628 expref: 23 pid: 5791 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782239956.264969:0:6611:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5ded65500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6611:1868813758962304:192.168.203.32@tcp:104: 00000100:00100000:0.0:1782239956.265130:0:6611:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c886c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782239956.265819:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239956.266008:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737979264 00000100:00100000:0.0:1782239956.266019:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737979264 00000100:00100000:0.0:1782239956.266097:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 132 00000100:00100000:0.0:1782239956.266108:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc08ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+24:10531:x1868813737979264:12345-192.168.203.32@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1782239956.266215:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030a00/0x8c5345f1c1ec55a1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239956.266237:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030a00/0x8c5345f1c1ec55a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239956.266252:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030a00/0x8c5345f1c1ec55a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239956.267888:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030a00/0x8c5345f1c1ec55a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239956.267908:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030a00/0x8c5345f1c1ec55a1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239956.268162:0:6611:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5ded65500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6611:1868813758962304:192.168.203.32@tcp:104: 00010000:00010000:0.0:1782239956.268455:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030a00/0x8c5345f1c1ec55a1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239956.269172:0:6611:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602172a00/0x8c5345f1c1ec559a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239956.269501:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239956.269672:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737979520 00000100:00100000:3.0:1782239956.269684:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737979520 00000100:00100000:3.0:1782239956.269778:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 33 00000100:00100000:3.0:1782239956.269789:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5dee26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+26:5564:x1868813737979520:12345-192.168.203.32@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1782239956.270119:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5dee26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+27:5564:x1868813737979520:12345-192.168.203.32@tcp:35:ldlm_bl.0 Request processed in 330us (622us total) trans 4294967411 rc 0/0 00000100:00100000:3.0:1782239956.270127:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 33 00010000:00010000:0.0:1782239956.271006:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5c0030a00 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:0.0:1782239956.271033:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030a00/0x8c5345f1c1ec55a1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239956.271048:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030a00/0x8c5345f1c1ec55a1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239956.271079:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bb5d0df4300) 00010000:00010000:0.0:1782239956.271083:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1782239956.271089:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030a00/0x8c5345f1c1ec55a1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239956.271098:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030a00/0x8c5345f1c1ec55a1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239956.272993:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239956.273226:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737979648 00000100:00100000:3.0:1782239956.273239:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737979648 00010000:00010000:3.0:1782239956.273290:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e400/0x8c5345f1c1ec5490 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e628 expref: 27 pid: 5791 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239956.273334:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 58 00000100:00100000:3.0:1782239956.273358:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5dee24a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+27:2347:x1868813737979648:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782239956.273378:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782239956.273385:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e400/0x8c5345f1c1ec5490 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e628 expref: 27 pid: 5791 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239956.273399:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e400/0x8c5345f1c1ec5490 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e628 expref: 27 pid: 5791 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239956.273425:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e400/0x8c5345f1c1ec5490 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e628 expref: 27 pid: 5791 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239956.273472:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bb5d0df4300) 00010000:00010000:3.0:1782239956.273478:0:5776:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602172a00/0x8c5345f1c1ec559a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239956.273488:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602172a00/0x8c5345f1c1ec559a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239956.273497:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602172a00/0x8c5345f1c1ec559a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239956.273522:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782239956.273740:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5dee24a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+26:2347:x1868813737979648:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 394us (761us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239956.273775:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 58 00010000:00010000:1.0:1782239956.275492:0:6611:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602172a00/0x8c5345f1c1ec559a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239956.275514:0:6611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602172a00/0x8c5345f1c1ec559a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782239956.275848:0:6611:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1782239956.275854:0:6611:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782239956.275885:0:6611:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602172a00/0x8c5345f1c1ec559a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239956.275970:0:6611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602172a00/0x8c5345f1c1ec559a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239956.276009:0:6611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602173600/0x8c5345f1c1ec5585 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239956.276015:0:6611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602173600/0x8c5345f1c1ec5585 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239956.276023:0:6611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602173600/0x8c5345f1c1ec5585 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239956.276030:0:6611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb602173600 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:1.0:1782239956.276035:0:6611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602173600/0x8c5345f1c1ec5585 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239956.276042:0:6611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602173600/0x8c5345f1c1ec5585 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239956.276061:0:6611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bb5c4ed6b00) 00010000:00010000:1.0:1782239956.276065:0:6611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782239956.276082:0:6611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602173600/0x8c5345f1c1ec5585 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239956.276088:0:6611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602173600/0x8c5345f1c1ec5585 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239956.276107:0:6611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602172c00/0x8c5345f1c1ec558c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782239956.276113:0:11535:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00010000:00010000:1.0:1782239956.276114:0:6611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602172c00/0x8c5345f1c1ec558c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782239956.276121:0:11535:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00010000:00010000:1.0:1782239956.276123:0:6611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602172c00/0x8c5345f1c1ec558c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239956.276136:0:6611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb602172c00 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:1.0:1782239956.276139:0:6611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602172c00/0x8c5345f1c1ec558c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239956.276145:0:6611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602172c00/0x8c5345f1c1ec558c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239956.276154:0:6611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bb5c55de900) 00010000:00010000:1.0:1782239956.276156:0:6611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782239956.276159:0:6611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602172c00/0x8c5345f1c1ec558c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239956.276164:0:6611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602172c00/0x8c5345f1c1ec558c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239956.276215:0:6611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602173200/0x8c5345f1c1ec5577 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e66e expref: 26 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239956.276231:0:6611:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602172a00/0x8c5345f1c1ec559a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e66e expref: 25 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239956.276238:0:6611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bb5d0df4300) 00010000:00010000:1.0:1782239956.276241:0:6611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782239956.276244:0:6611:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb602172a00, rc 0) 00000100:00100000:1.0:1782239956.276382:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5dee24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+25:10529:x1868813737979008:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 14348us (14860us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239956.276392:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 131 00000040:00080000:0.0:1782239956.276645:0:11535:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1782239956.276655:0:11535:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1782239956.276703:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc08ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+24:10531:x1868813737979264:12345-192.168.203.32@tcp:57:lhsmtool_posix.0 Request processed in 10594us (10888us total) trans 4294967410 rc 0/0 00000100:00100000:2.0:1782239956.276715:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 132 00000100:00100000:2.0:1782239956.281699:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239956.281880:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737979904 00000100:00100000:3.0:1782239956.281908:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737979904 00000100:00100000:3.0:1782239956.281974:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 34 00000100:00100000:3.0:1782239956.281987:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5dee26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+24:10531:x1868813737979904:12345-192.168.203.32@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1782239956.282466:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5dee26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+25:10531:x1868813737979904:12345-192.168.203.32@tcp:35:lhsmtool_posix.0 Request processed in 480us (780us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1782239956.282476:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 34 00010000:00010000:3.0:1782239957.216048:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1782239957.415104:0:11905:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782239957.415119:0:11905:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1782239957.418075:0:11905:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1782239957.418089:0:11905:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1782239957.765689:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239957.765868:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737980160 00000100:00100000:3.0:1782239957.765893:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737980160 00000100:00100000:3.0:1782239957.765989:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 133 00000100:00100000:3.0:1782239957.766001:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ded64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+25:10554:x1868813737980160:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:3.0:1782239957.766027:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782239957.766050:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26600/0x8c5345f1c1ec55a8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e675 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239957.766170:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27800/0x8c5345f1c1ec55af lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239957.766187:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27800/0x8c5345f1c1ec55af lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239957.766200:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27800/0x8c5345f1c1ec55af lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782239957.766213:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1782239957.766372:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26600/0x8c5345f1c1ec55a8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e675 expref: 28 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239957.766396:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27800/0x8c5345f1c1ec55af lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e675 expref: 27 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239957.766405:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bb5d0df4300) 00010000:00010000:3.0:1782239957.766408:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1782239957.766411:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5f7e27800, rc 0) 00000100:00100000:3.0:1782239957.766469:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ded64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+27:10554:x1868813737980160:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 471us (792us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1782239957.766479:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 133 00000100:00080000:0.0:1782239957.766575:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782239957.773134:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239957.773172:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737980288 00000100:00100000:3.0:1782239957.773180:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737980288 00000100:00100000:3.0:1782239957.773230:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 134 00000100:00100000:3.0:1782239957.773240:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc08c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+27:10554:x1868813737980288:12345-192.168.203.32@tcp:54:lfs.0 00010000:00010000:3.0:1782239957.773306:0:6611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27c00/0x8c5345f1c1ec55bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239957.773325:0:6611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27c00/0x8c5345f1c1ec55bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239957.773350:0:6611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27c00/0x8c5345f1c1ec55bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239957.773382:0:6611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27c00/0x8c5345f1c1ec55bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239957.773390:0:6611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27c00/0x8c5345f1c1ec55bd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239957.773398:0:6611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27c00/0x8c5345f1c1ec55bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239957.773405:0:6611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f7e27c00 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:3.0:1782239957.773409:0:6611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27c00/0x8c5345f1c1ec55bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239957.773417:0:6611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27c00/0x8c5345f1c1ec55bd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239957.773429:0:6611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bb5d0df4300) 00010000:00010000:3.0:1782239957.773432:0:6611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782239957.773449:0:6611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27c00/0x8c5345f1c1ec55bd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239957.773455:0:6611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27c00/0x8c5345f1c1ec55bd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239957.773518:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc08c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+27:10554:x1868813737980288:12345-192.168.203.32@tcp:54:lfs.0 Request processed in 279us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239957.773526:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 134 00000100:00100000:2.0:1782239957.889097:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239957.889230:0:8312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737980416 00000100:00100000:1.0:1782239957.889254:0:8312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737980416 00000100:00100000:1.0:1782239957.889335:0:8312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 46 00000100:00100000:1.0:1782239957.889347:0:8312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8eca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+6:2345:x1868813737980416:12345-192.168.203.32@tcp:101:cat.0 00010000:00010000:1.0:1782239957.889376:0:8312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782239957.889400:0:8312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf533121/0x8c5345f1c1ec55c4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e67c expref: -99 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782239957.889427:0:8312:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a3ad2d3, atime: 0x6a3ad2d2, ctime: 0x6a3ad2d3, blocks: 0xb 00010000:00010000:1.0:1782239957.889448:0:8312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=336s v=(0 0) 00010000:00010000:1.0:1782239957.889453:0:8312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782239957.889464:0:8312:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf533121/0x8c5345f1c1ec55c4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e67c expref: 7 pid: 8312 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239957.889485:0:8312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cf533121/0x8c5345f1c1ec55c4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e67c expref: 7 pid: 8312 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239957.889498:0:8312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5f7e38600, rc 0) 00000100:00100000:1.0:1782239957.889562:0:8312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8eca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+7:2345:x1868813737980416:12345-192.168.203.32@tcp:101:cat.0 Request processed in 217us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239957.889569:0:8312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 46 00000100:00080000:0.0:1782239957.889901:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782239957.896482:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239957.896653:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737980544 00000100:00100000:2.0:1782239957.896664:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737980544 00002000:00100000:2.0:1782239957.896729:0:6595:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff9bb5ded65180 x1868813737980544/t0(0) o3->36dd742b-25b8-431e-bf41-75f2fff47ffb@192.168.203.32@tcp:558/0 lens 488/0 e 0 to 0 dl 1782239968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782239957.896794:0:6595:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9bb5ded65180 with x1868813737980544 ext(0->4095) 00002000:00010000:2.0:1782239957.896800:0:6595:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bb5ded65180 00000100:00100000:2.0:1782239957.896833:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 3 00000100:00100000:2.0:1782239957.896843:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ded65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+7:2345:x1868813737980544:12345-192.168.203.32@tcp:3:cat.0 00000100:00100000:2.0:1782239957.897076:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ded65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+7:2345:x1868813737980544:12345-192.168.203.32@tcp:3:cat.0 Request processed in 234us (605us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1782239957.897084:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 3 00002000:00100000:2.0:1782239957.897090:0:6595:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff9bb5ded65180 x1868813737980544/t0(0) o3->36dd742b-25b8-431e-bf41-75f2fff47ffb@192.168.203.32@tcp:558/0 lens 488/4536 e 0 to 0 dl 1782239968 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782239957.897099:0:6595:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9bb5ded65180 with x1868813737980544 ext(0->4095) 00002000:00010000:2.0:1782239957.897103:0:6595:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bb5ded65180 00010000:00010000:2.0:1782239958.239318:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782239958.303236:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5e8ec8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813758962432:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782239958.303313:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239958.303535:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758962432 00000100:00100000:3.0:1782239958.303542:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758962432 00000100:00100000:3.0:1782239958.303604:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1782239958.303613:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ded65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1868813758962432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782239958.303649:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782239958.303697:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ded65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1868813758962432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239958.303705:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1782239958.303896:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5e8ec8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813758962432:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1782239958.303959:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782239959.060465:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239959.060521:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239959.060572:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239959.060596:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239959.060646:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239959.060688:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737980928 00000100:00100000:3.0:1782239959.060702:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737980928 00000100:00100000:3.0:1782239959.060808:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737981056 00000100:00100000:3.0:1782239959.060811:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737981056 00000100:00100000:3.0:1782239959.060845:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 80 00000100:00100000:3.0:1782239959.060857:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+7:2347:x1868813737980928:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:3.0:1782239959.060953:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+7:2347:x1868813737980928:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 98us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239959.060974:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 80 00000100:00100000:3.0:1782239959.061010:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 81 00000100:00100000:3.0:1782239959.061018:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7e60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+5:2346:x1868813737981056:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:1.0:1782239959.061370:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737980672 00000100:00100000:1.0:1782239959.061375:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737980672 00000100:00100000:1.0:1782239959.061414:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 290 00000100:00100000:1.0:1782239959.061432:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d1bac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afaefb1a-536b-42a3-a3ff-47200f8611c3+13:2347:x1868813737980672:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:1.0:1782239959.061475:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d1bac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afaefb1a-536b-42a3-a3ff-47200f8611c3+13:2347:x1868813737980672:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 45us (1036us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239959.061493:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 290 00000100:00080000:1.0:1782239959.061637:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782239959.061642:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782239959.062243:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7e60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+5:2346:x1868813737981056:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 1221us (1592us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239959.062253:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 81 00000100:00100000:3.0:1782239959.062288:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737981184 00000100:00100000:3.0:1782239959.062293:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737981184 00000100:00100000:3.0:1782239959.062348:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737980800 00000100:00100000:3.0:1782239959.062351:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737980800 00000100:00100000:3.0:1782239959.062385:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 146 00000100:00100000:3.0:1782239959.062392:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7e0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f135cc01-3d42-4f2a-80ff-79724f1d3285+5:2347:x1868813737981184:12345-192.168.203.32@tcp:400:kworker.0 00000100:00080000:0.0:1782239959.062733:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782239959.063298:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7e0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f135cc01-3d42-4f2a-80ff-79724f1d3285+5:2347:x1868813737981184:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 901us (2720us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239959.063309:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 146 00000100:00100000:3.0:1782239959.063348:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 147 00000100:00100000:3.0:1782239959.063360:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7e60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+27:2346:x1868813737980800:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:3.0:1782239959.063406:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7e60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+27:2346:x1868813737980800:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 52us (2808us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239959.063414:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 147 00010000:00010000:3.0:1782239959.263240:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782239959.329663:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5ded67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3307:1868813758962560:0@lo:400:kworker.0 00000100:00100000:0.0:1782239959.332234:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239959.332329:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f7ce2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1868813758963072:0@lo:400:kworker.0 00000100:00100000:0.0:1782239959.332402:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239959.332456:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782239959.332464:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5ded64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1868813758962944:0@lo:400:kworker.0 00000100:00100000:0.0:1782239959.332518:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239959.332566:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5ded67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1868813758962688:0@lo:400:kworker.0 00000100:00100000:0.0:1782239959.332593:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239959.332613:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f7ce0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1868813758963200:0@lo:400:kworker.0 00000100:00100000:0.0:1782239959.332638:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239959.332656:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782239959.332663:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5ded65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1868813758962816:0@lo:400:kworker.0 00000100:00100000:0.0:1782239959.332685:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239959.332724:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758962560 00000100:00100000:0.0:1782239959.332733:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758962560 00000100:00100000:3.0:1782239959.333185:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758963072 00000100:00100000:3.0:1782239959.333192:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758963072 00000100:00100000:3.0:1782239959.333250:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758962688 00000100:00100000:3.0:1782239959.333254:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758962688 00000100:00100000:3.0:1782239959.333282:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758962816 00000100:00100000:3.0:1782239959.333285:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758962816 00000100:00100000:3.0:1782239959.333309:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1782239959.333320:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7ce3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1868813758963072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782239959.333402:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7ce3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1868813758963072:12345-0@lo:400:kworker.0 Request processed in 84us (999us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239959.333410:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1782239959.333432:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1782239959.333438:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc2a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1868813758962688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782239959.333473:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc2a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1868813758962688:12345-0@lo:400:kworker.0 Request processed in 35us (878us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239959.333479:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1782239959.333491:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1782239959.333498:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc2ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1868813758962816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782239959.333527:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc2ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1868813758962816:12345-0@lo:400:kworker.0 Request processed in 30us (841us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239959.333534:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1782239959.333567:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758962944 00000100:00100000:3.0:1782239959.333572:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758962944 00000100:00100000:3.0:1782239959.333595:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758963200 00000100:00100000:3.0:1782239959.333597:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758963200 00000100:00100000:3.0:1782239959.333620:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1782239959.333626:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc2a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1868813758962944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782239959.333661:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc2a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1868813758962944:12345-0@lo:400:kworker.0 Request processed in 34us (1142us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239959.333667:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1782239959.333678:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1782239959.333692:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc2abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3304:x1868813758963200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782239959.333724:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc2abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3304:x1868813758963200:12345-0@lo:400:kworker.0 Request processed in 33us (1085us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239959.333730:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:3.0:1782239959.333785:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782239959.337383:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1782239959.337410:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d1bafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:3307:x1868813758962560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782239959.337528:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d1bafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:3307:x1868813758962560:12345-0@lo:400:kworker.0 Request processed in 130us (5306us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239959.337537:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1782239959.337656:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5ded65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1868813758962816:0@lo:400:kworker.0 00000100:00100000:0.0:1782239959.337672:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5ded67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1868813758962688:0@lo:400:kworker.0 00000100:00100000:0.0:1782239959.337687:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f7ce0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1868813758963200:0@lo:400:kworker.0 00000100:00100000:0.0:1782239959.337734:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5ded64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1868813758962944:0@lo:400:kworker.0 00000100:00100000:0.0:1782239959.337744:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5ded67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3307:1868813758962560:0@lo:400:kworker.0 00000100:00100000:0.0:1782239959.337780:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f7ce2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1868813758963072:0@lo:400:kworker.0 00000100:00080000:3.0:1782239959.337835:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782239959.841779:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5e8ec8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813758963328:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782239959.841849:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239959.841951:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758963328 00000100:00100000:2.0:1782239959.841959:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758963328 00000100:00100000:2.0:1782239959.842014:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1782239959.842024:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5c513c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1868813758963328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782239959.842068:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782239959.842118:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5c513c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1868813758963328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239959.842126:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1782239959.842169:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5e8ec8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813758963328:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782239960.286907:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1782239960.959957:0:7493:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00010000:00010000:3.0:1782239961.317688:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1782239961.477801:0:6614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:2.0:1782239961.477821:0:6614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:3.0:1782239961.490285:0:5812:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967410 is committed 00000020:00080000:3.0:1782239961.490327:0:5812:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:3.0:1782239961.490342:0:5812:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 2 batchid updated 00000020:00080000:3.0:1782239961.490365:0:5812:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bb5c7f88900 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:3.0:1782239961.490370:0:5812:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9bb5f7ceda00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bb5c7f88600 00000020:00080000:3.0:1782239961.490374:0:5812:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9bb5c8aec600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bb5f4634400 00000001:00080000:3.0:1782239961.490382:0:5812:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:0.0:1782239961.490494:0:5823:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:0.0:1782239961.490786:0:5823:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:2.0:1782239962.334906:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782239963.359368:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782239963.424463:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782239963.424494:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5e8ec8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1868813758963456:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782239963.424651:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239963.425519:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758963456 00000100:00100000:2.0:1782239963.425533:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758963456 00000100:00100000:2.0:1782239963.425693:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1782239963.425705:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc2aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1868813758963456:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1782239963.426518:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1782239963.426640:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782239963.427549:0:3307:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:0.0:1782239963.427560:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:2.0:1782239963.428232:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc2aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1868813758963456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2523us (3575us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239963.428245:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1782239963.428554:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5e8ec8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1868813758963456:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782239964.097423:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239964.097472:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737981312 00000100:00100000:3.0:1782239964.097484:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737981312 00000100:00100000:3.0:1782239964.097579:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 135 00000100:00100000:3.0:1782239964.097591:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+14:10215:x1868813737981312:12345-192.168.203.32@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1782239964.097724:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+14:10215:x1868813737981312:12345-192.168.203.32@tcp:60:lhsmtool_posix.0 Request processed in 134us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239964.097733:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 135 00000100:00080000:3.0:1782239964.097792:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782239964.108104:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239964.108316:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737981568 00000100:00100000:1.0:1782239964.108330:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737981568 00000100:00100000:1.0:1782239964.108392:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 35 00000100:00100000:1.0:1782239964.108403:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8eeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+14:10215:x1868813737981568:12345-192.168.203.32@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1782239964.109068:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8eeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+15:10215:x1868813737981568:12345-192.168.203.32@tcp:35:lhsmtool_posix.0 Request processed in 661us (974us total) trans 4294967414 rc 0/0 00000100:00100000:1.0:1782239964.109078:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 35 00000100:00100000:3.0:1782239964.191895:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239964.191932:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239964.192025:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239964.192059:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239964.192094:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239964.192128:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737982208 00000100:00100000:3.0:1782239964.192140:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737982208 00000100:00100000:3.0:1782239964.192205:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737981824 00000100:00100000:3.0:1782239964.192208:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737981824 00000100:00100000:3.0:1782239964.192240:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 151 00000100:00100000:3.0:1782239964.192252:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7813100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f135cc01-3d42-4f2a-80ff-79724f1d3285+5:2345:x1868813737982208:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:2.0:1782239964.192437:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 152 00000100:00100000:2.0:1782239964.192459:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7812680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+15:2345:x1868813737981824:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:3.0:1782239964.192533:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7813100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f135cc01-3d42-4f2a-80ff-79724f1d3285+5:2345:x1868813737982208:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 283us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239964.192541:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 151 00000100:00100000:3.0:1782239964.192570:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737981952 00000100:00100000:3.0:1782239964.192574:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737981952 00000100:00100000:3.0:1782239964.192602:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737982080 00000100:00100000:3.0:1782239964.192604:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737982080 00000100:00100000:3.0:1782239964.192624:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 84 00000100:00100000:3.0:1782239964.192630:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+6:2345:x1868813737981952:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:0.0:1782239964.192699:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737981696 00000100:00100000:0.0:1782239964.192704:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737981696 00000100:00100000:0.0:1782239964.192737:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 292 00000100:00100000:0.0:1782239964.192744:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d1baf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afaefb1a-536b-42a3-a3ff-47200f8611c3+13:2345:x1868813737981696:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:1.0:1782239964.192922:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 85 00000100:00100000:1.0:1782239964.192933:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7811c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+5:2345:x1868813737982080:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:2.0:1782239964.195457:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7812680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+15:2345:x1868813737981824:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 2974us (3368us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239964.195477:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 152 00000100:00080000:2.0:1782239964.195587:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782239964.195595:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782239964.195599:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782239964.196089:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+6:2345:x1868813737981952:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 3454us (4150us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239964.196101:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 84 00000100:00100000:0.0:1782239964.197505:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d1baf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afaefb1a-536b-42a3-a3ff-47200f8611c3+13:2345:x1868813737981696:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 4747us (5611us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239964.197521:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 292 00000100:00100000:2.0:1782239964.202864:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7811c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+5:2345:x1868813737982080:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 9916us (10750us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239964.202884:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 85 00010000:00010000:2.0:1782239964.383482:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782239964.400518:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239964.400787:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737982336 00000100:00100000:1.0:1782239964.400802:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737982336 00000100:00100000:1.0:1782239964.400880:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 136 00000100:00100000:1.0:1782239964.400891:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7813800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f135cc01-3d42-4f2a-80ff-79724f1d3285+5:11007:x1868813737982336:12345-192.168.203.32@tcp:101:lsof.0 00010000:00010000:1.0:1782239964.400919:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782239964.400944:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38c00/0x8c5345f1c1ec55cb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e683 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239964.401036:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39600/0x8c5345f1c1ec55d2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239964.401077:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39600/0x8c5345f1c1ec55d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239964.401091:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39600/0x8c5345f1c1ec55d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782239964.401515:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1782239964.401521:0:5791:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1782239964.401633:0:5791:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39600/0x8c5345f1c1ec55d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239964.401663:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38c00/0x8c5345f1c1ec55cb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e683 expref: 7 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239964.401683:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39600/0x8c5345f1c1ec55d2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e683 expref: 6 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239964.401692:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bb5d0df4400) 00010000:00010000:1.0:1782239964.401696:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782239964.401700:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5f7e39600, rc 0) 00000100:00100000:1.0:1782239964.401843:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7813800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f135cc01-3d42-4f2a-80ff-79724f1d3285+6:11007:x1868813737982336:12345-192.168.203.32@tcp:101:lsof.0 Request processed in 953us (1340us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239964.401852:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 136 00000100:00100000:1.0:1782239964.447275:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fc29ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1868813758963840:0@lo:400:kworker.0 00000100:00100000:3.0:1782239964.447373:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fc299f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813758963968:0@lo:400:kworker.0 00000100:00100000:1.0:1782239964.447374:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239964.447455:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1782239964.447465:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239964.447470:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fc299180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1868813758963712:0@lo:400:kworker.0 00000100:00100000:1.0:1782239964.447510:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239964.447517:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1782239964.447529:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fc298000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3306:1868813758963584:0@lo:400:kworker.0 00000100:00100000:1.0:1782239964.447549:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fc29b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813758964224:0@lo:400:kworker.0 00000100:00100000:3.0:1782239964.447577:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239964.447589:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239964.447632:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fc299880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1868813758964096:0@lo:400:kworker.0 00000040:00080000:2.0:1782239964.447848:0:11535:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1782239964.447855:0:11535:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:3.0:1782239964.448152:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239964.448237:0:8312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758963968 00000100:00100000:3.0:1782239964.448259:0:8312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758963968 00000040:00080000:2.0:1782239964.448261:0:11535:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:2.0:1782239964.448271:0:11535:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1782239964.448341:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758963840 00000100:00100000:2.0:1782239964.448349:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758963840 00000100:00100000:2.0:1782239964.448408:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758963712 00000100:00100000:2.0:1782239964.448412:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758963712 00000100:00100000:2.0:1782239964.448424:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758964096 00000100:00100000:2.0:1782239964.448426:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758964096 00000100:00100000:2.0:1782239964.448443:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1782239964.448451:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc29aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1868813758963840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782239964.448516:0:8312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758964224 00000100:00100000:3.0:1782239964.448523:0:8312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758964224 00000100:00100000:2.0:1782239964.448528:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc29aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1868813758963840:12345-0@lo:400:kworker.0 Request processed in 75us (1154us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239964.448540:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1782239964.448570:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1782239964.448578:0:8312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1782239964.448586:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc298380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1868813758963712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782239964.448596:0:8312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7810000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1868813758963968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782239964.448623:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc298380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1868813758963712:12345-0@lo:400:kworker.0 Request processed in 41us (1110us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239964.448631:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1782239964.448645:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1782239964.448652:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7811180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1868813758964096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782239964.448689:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7811180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1868813758964096:12345-0@lo:400:kworker.0 Request processed in 39us (1023us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239964.448695:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1782239964.448717:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1782239964.448724:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc298a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1868813758964224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782239964.448791:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc298a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1868813758964224:12345-0@lo:400:kworker.0 Request processed in 68us (1203us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239964.448798:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:2.0:1782239964.448821:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782239964.448827:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782239964.448871:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fc299880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1868813758964096:0@lo:400:kworker.0 00000100:00100000:2.0:1782239964.449004:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fc299f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813758963968:0@lo:400:kworker.0 00000100:00100000:0.0:1782239964.449105:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758963584 00000100:00100000:0.0:1782239964.449112:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758963584 00000100:00100000:0.0:1782239964.449154:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1782239964.449162:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d1bae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:3306:x1868813758963584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782239964.449215:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d1bae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:3306:x1868813758963584:12345-0@lo:400:kworker.0 Request processed in 55us (1642us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239964.449222:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1782239964.449263:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fc298000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3306:1868813758963584:0@lo:400:kworker.0 00000100:00100000:3.0:1782239964.449359:0:8312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7810000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1868813758963968:12345-0@lo:400:kworker.0 Request processed in 764us (1896us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239964.449371:0:3305:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000100:00100000:3.0:1782239964.449372:0:8312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000004:00080000:1.0:1782239964.449383:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bb5fc08d880, transno 4294967304 00000100:00100000:1.0:1782239964.449399:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fc29b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813758964224:0@lo:400:kworker.0 00000100:00100000:1.0:1782239964.449417:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fc29ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1868813758963840:0@lo:400:kworker.0 00000100:00100000:1.0:1782239964.449440:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fc299180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1868813758963712:0@lo:400:kworker.0 00000100:00100000:1.0:1782239964.959131:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5e8eca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813758964352:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782239964.959239:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239964.959384:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758964352 00000100:00100000:3.0:1782239964.959396:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758964352 00000100:00100000:3.0:1782239964.959469:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1782239964.959480:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ee018c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1868813758964352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782239964.959528:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782239964.968946:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ee018c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1868813758964352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 9451us (9691us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239964.968968:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1782239964.969618:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5e8eca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813758964352:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782239965.409895:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782239966.431039:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1782239966.592826:0:5812:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000001:00080000:1.0:1782239966.592868:0:5812:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:2.0:1782239966.593120:0:5823:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:2.0:1782239966.593141:0:5823:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:3.0:1782239967.464866:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1782239968.211734:0:12111:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 14:39:26 (1782239966) 00010000:00010000:2.0:1782239968.490694:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782239968.545582:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5e8eca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813758964480:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782239968.545660:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239968.545995:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758964480 00000100:00100000:2.0:1782239968.546004:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758964480 00000100:00100000:2.0:1782239968.546070:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1782239968.546081:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc2a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1868813758964480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782239968.546118:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782239968.546163:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc2a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1868813758964480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239968.546182:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1782239968.546408:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5e8eca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813758964480:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1782239968.546470:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782239969.318270:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239969.318322:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239969.318357:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239969.318615:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737982720 00000100:00100000:2.0:1782239969.318625:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737982720 00000100:00100000:2.0:1782239969.318705:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 88 00000100:00100000:2.0:1782239969.318715:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc299180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+6:2346:x1868813737982720:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:2.0:1782239969.318823:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc299180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+6:2346:x1868813737982720:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 110us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239969.318831:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 88 00000100:00100000:0.0:1782239969.318933:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737982464 00000100:00100000:0.0:1782239969.318937:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737982464 00000100:00100000:0.0:1782239969.318988:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 294 00000100:00100000:0.0:1782239969.318996:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d1baf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afaefb1a-536b-42a3-a3ff-47200f8611c3+13:2346:x1868813737982464:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:0.0:1782239969.319024:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d1baf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afaefb1a-536b-42a3-a3ff-47200f8611c3+13:2346:x1868813737982464:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 30us (767us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239969.319030:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 294 00000100:00100000:1.0:1782239969.321057:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239969.321164:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239969.321240:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737982976 00000100:00100000:2.0:1782239969.321248:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737982976 00000100:00100000:2.0:1782239969.321302:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737982592 00000100:00100000:2.0:1782239969.321306:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737982592 00000100:00100000:2.0:1782239969.321326:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 156 00000100:00100000:2.0:1782239969.321334:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc29ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f135cc01-3d42-4f2a-80ff-79724f1d3285+6:2346:x1868813737982976:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:2.0:1782239969.321405:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc29ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f135cc01-3d42-4f2a-80ff-79724f1d3285+6:2346:x1868813737982976:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 71us (3047us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239969.321412:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 156 00000100:00100000:2.0:1782239969.321429:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 157 00000100:00100000:2.0:1782239969.321435:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc29b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+14:2346:x1868813737982592:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:2.0:1782239969.321460:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc29b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+14:2346:x1868813737982592:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 25us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239969.321467:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 157 00000100:00100000:2.0:1782239969.321485:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737982848 00000100:00100000:2.0:1782239969.321490:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737982848 00000100:00100000:2.0:1782239969.321512:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 89 00000100:00100000:2.0:1782239969.321518:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc298700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+5:2346:x1868813737982848:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:2.0:1782239969.321561:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc298700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+5:2346:x1868813737982848:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 42us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239969.321567:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 89 00000100:00080000:3.0:1782239969.322166:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782239969.322172:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782239969.322174:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1782239969.502959:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782239969.567879:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fc2a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1868813758964864:0@lo:400:kworker.0 00000100:00100000:1.0:1782239969.567954:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239969.568031:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1782239969.568038:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fc2a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1868813758964736:0@lo:400:kworker.0 00000100:00100000:1.0:1782239969.568062:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239969.568079:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fc2a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813758965248:0@lo:400:kworker.0 00000100:00100000:1.0:1782239969.568121:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239969.568168:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fc2aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813758964992:0@lo:400:kworker.0 00000100:00100000:1.0:1782239969.568191:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239969.568206:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1782239969.568212:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fc2ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3306:1868813758964608:0@lo:400:kworker.0 00000100:00100000:1.0:1782239969.568239:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239969.568268:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fc2a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1868813758965120:0@lo:400:kworker.0 00000100:00100000:1.0:1782239969.568290:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239969.568314:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758965248 00000100:00100000:1.0:1782239969.568321:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758965248 00000100:00100000:1.0:1782239969.568370:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758964992 00000100:00100000:1.0:1782239969.568373:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758964992 00000100:00100000:1.0:1782239969.568394:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1782239969.568403:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc298e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1868813758965248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782239969.568472:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc298e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1868813758965248:12345-0@lo:400:kworker.0 Request processed in 69us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239969.568479:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1782239969.568496:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1782239969.568502:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc29bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1868813758964992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782239969.568531:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc29bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1868813758964992:12345-0@lo:400:kworker.0 Request processed in 30us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239969.568538:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:1.0:1782239969.568554:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782239969.568581:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fc2a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813758965248:0@lo:400:kworker.0 00000100:00100000:1.0:1782239969.568606:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fc2aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813758964992:0@lo:400:kworker.0 00000100:00100000:0.0:1782239969.569294:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758964864 00000100:00100000:0.0:1782239969.569300:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758964864 00000100:00100000:0.0:1782239969.569361:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758964736 00000100:00100000:0.0:1782239969.569364:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758964736 00000100:00100000:0.0:1782239969.569377:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758965120 00000100:00100000:0.0:1782239969.569379:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758965120 00000100:00100000:0.0:1782239969.569394:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1782239969.569401:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc29a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1868813758964864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782239969.569470:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc29a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1868813758964864:12345-0@lo:400:kworker.0 Request processed in 69us (1517us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239969.569477:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1782239969.569491:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1782239969.569496:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc299500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1868813758964736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782239969.569524:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc299500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1868813758964736:12345-0@lo:400:kworker.0 Request processed in 28us (1461us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239969.569530:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1782239969.569553:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1782239969.569560:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc29b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1868813758965120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782239969.569615:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc29b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1868813758965120:12345-0@lo:400:kworker.0 Request processed in 38us (1306us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239969.569622:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1782239969.569672:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fc2a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1868813758964736:0@lo:400:kworker.0 00000100:00100000:0.0:1782239969.569686:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fc2a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1868813758964864:0@lo:400:kworker.0 00000100:00100000:0.0:1782239969.569718:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fc2a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1868813758965120:0@lo:400:kworker.0 00000100:00100000:2.0:1782239969.570121:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758964608 00000100:00100000:2.0:1782239969.570136:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758964608 00000100:00100000:2.0:1782239969.570168:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1782239969.570176:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d1bae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:3306:x1868813758964608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782239969.570223:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d1bae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:3306:x1868813758964608:12345-0@lo:400:kworker.0 Request processed in 48us (1983us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239969.570239:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1782239969.570363:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fc2ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3306:1868813758964608:0@lo:400:kworker.0 00000100:00080000:1.0:1782239969.570721:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782239969.866786:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239969.866890:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737983232 00000100:00100000:0.0:1782239969.866900:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737983232 00000100:00100000:0.0:1782239969.866966:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 137 00000100:00100000:0.0:1782239969.866986:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc29a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+14:11271:x1868813737983232:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782239969.867010:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782239969.867032:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030a00/0x8c5345f1c1ec55d9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e68a expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239969.867116:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030e00/0x8c5345f1c1ec55e0 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239969.867131:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030e00/0x8c5345f1c1ec55e0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239969.867141:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030e00/0x8c5345f1c1ec55e0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239969.867154:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031e00/0x8c5345f1c1ec55e7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239969.867174:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031e00/0x8c5345f1c1ec55e7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239969.867181:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031e00/0x8c5345f1c1ec55e7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239969.867591:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030800/0x8c5345f1c1ec55ee lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239969.867600:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030800/0x8c5345f1c1ec55ee lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239969.867607:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030800/0x8c5345f1c1ec55ee lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782239969.867616:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1782239969.867846:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030e00/0x8c5345f1c1ec55e0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239969.867854:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030e00/0x8c5345f1c1ec55e0 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239969.867861:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030e00/0x8c5345f1c1ec55e0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239969.867867:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5c0030e00 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:0.0:1782239969.867871:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030e00/0x8c5345f1c1ec55e0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239969.867879:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030e00/0x8c5345f1c1ec55e0 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239969.867900:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9bb5c4ed6000) 00010000:00010000:0.0:1782239969.867902:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782239969.867906:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030e00/0x8c5345f1c1ec55e0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239969.867911:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030e00/0x8c5345f1c1ec55e0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239969.867923:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031e00/0x8c5345f1c1ec55e7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239969.867930:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031e00/0x8c5345f1c1ec55e7 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239969.867935:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031e00/0x8c5345f1c1ec55e7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239969.867941:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5c0031e00 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:0.0:1782239969.867943:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031e00/0x8c5345f1c1ec55e7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239969.867949:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031e00/0x8c5345f1c1ec55e7 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239969.867956:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9bb5c55de500) 00010000:00010000:0.0:1782239969.867958:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782239969.867961:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031e00/0x8c5345f1c1ec55e7 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239969.867966:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031e00/0x8c5345f1c1ec55e7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239969.868360:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030a00/0x8c5345f1c1ec55d9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e68a expref: 17 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239969.868375:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030800/0x8c5345f1c1ec55ee lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e68a expref: 16 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239969.868382:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bb5d0df4b00) 00010000:00010000:0.0:1782239969.868383:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782239969.868386:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5c0030800, rc 0) 00000100:00100000:0.0:1782239969.868457:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc29a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+16:11271:x1868813737983232:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 1472us (1679us total) trans 4294967415 rc 0/0 00000100:00100000:0.0:1782239969.868476:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 137 00000100:00100000:3.0:1782239969.877936:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239969.878019:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239969.878130:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737983360 00000100:00100000:0.0:1782239969.878140:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737983360 00000100:00100000:0.0:1782239969.878196:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 138 00000100:00100000:0.0:1782239969.878206:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7812d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+16:11271:x1868813737983360:12345-192.168.203.32@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1782239969.878331:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7812d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+16:11271:x1868813737983360:12345-192.168.203.32@tcp:59:lhsmtool_posix.0 Request processed in 125us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239969.878347:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 138 00000100:00100000:1.0:1782239969.878691:0:7481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737983488 00000100:00100000:1.0:1782239969.878696:0:7481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737983488 00000100:00100000:1.0:1782239969.878741:0:7481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 9 00000100:00100000:1.0:1782239969.878777:0:7481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7811f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+16:2344:x1868813737983488:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782239969.878790:0:7481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782239969.878815:0:7481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030800/0x8c5345f1c1ec55ee lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e68a expref: 16 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239969.878836:0:7481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bb5d0df4b00) 00010000:00010000:1.0:1782239969.878841:0:7481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782239969.878862:0:7481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7811f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+15:2344:x1868813737983488:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 115us (843us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239969.878869:0:7481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 9 00000100:00100000:0.0:1782239970.082123:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5e8ecb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813758965376:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782239970.082191:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239970.082417:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758965376 00000100:00100000:2.0:1782239970.082425:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758965376 00000100:00100000:2.0:1782239970.082488:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1782239970.082498:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc2a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1868813758965376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782239970.082536:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782239970.082581:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc2a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1868813758965376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239970.082588:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1782239970.082680:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5e8ecb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813758965376:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782239970.528227:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1782239970.601152:0:11535:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1782239970.601162:0:11535:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1782239970.601214:0:11535:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:0.0:1782239970.601221:0:11535:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1782239971.551980:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1782239971.694626:0:5812:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000100:00100000:0.0:1782239972.562994:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239972.563484:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737983616 00000100:00100000:3.0:1782239972.563498:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737983616 00000100:00100000:3.0:1782239972.563578:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 139 00000100:00100000:3.0:1782239972.563592:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc2a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+14:11314:x1868813737983616:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:3.0:1782239972.563632:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782239972.563661:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27c00/0x8c5345f1c1ec55fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e691 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1782239972.563844:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1782239972.564033:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26600/0x8c5345f1c1ec5603 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239972.564052:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26600/0x8c5345f1c1ec5603 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239972.564068:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26600/0x8c5345f1c1ec5603 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239972.564085:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27400/0x8c5345f1c1ec560a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239972.564093:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27400/0x8c5345f1c1ec560a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239972.564105:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27400/0x8c5345f1c1ec560a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239972.564721:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26600/0x8c5345f1c1ec5603 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239972.564734:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26600/0x8c5345f1c1ec5603 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239972.565869:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26600/0x8c5345f1c1ec5603 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239972.565889:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f7e26600 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:3.0:1782239972.565912:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26600/0x8c5345f1c1ec5603 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239972.565922:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26600/0x8c5345f1c1ec5603 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239972.565944:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bb5d0df4400) 00010000:00010000:3.0:1782239972.565948:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782239972.565966:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26600/0x8c5345f1c1ec5603 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239972.565974:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26600/0x8c5345f1c1ec5603 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239972.565998:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27400/0x8c5345f1c1ec560a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239972.566005:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27400/0x8c5345f1c1ec560a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239972.566013:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27400/0x8c5345f1c1ec560a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239972.566021:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f7e27400 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:3.0:1782239972.566024:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27400/0x8c5345f1c1ec560a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239972.566030:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27400/0x8c5345f1c1ec560a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239972.566039:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9bb5d0df4e00) 00010000:00010000:3.0:1782239972.566041:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782239972.566051:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27400/0x8c5345f1c1ec560a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239972.566058:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27400/0x8c5345f1c1ec560a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239972.566123:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27c00/0x8c5345f1c1ec55fc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e691 expref: 15 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239972.566136:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bb5d0df4400) 00010000:00010000:3.0:1782239972.566139:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782239972.566143:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27c00/0x8c5345f1c1ec55fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e691 expref: 15 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239972.566879:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5f7e27c00, rc 0) 00000100:00100000:3.0:1782239972.567034:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc2a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+14:11314:x1868813737983616:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 3442us (4051us total) trans 0 rc 301/301 00000100:00100000:3.0:1782239972.567045:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 139 00010000:00010000:3.0:1782239972.581405:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782239972.584055:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239972.587532:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737983872 00000100:00100000:2.0:1782239972.587554:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737983872 00000100:00100000:3.0:1782239972.587713:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 140 00000100:00100000:3.0:1782239972.587727:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc2a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+14:11314:x1868813737983872:12345-192.168.203.32@tcp:36:lfs.0 00010000:00010000:3.0:1782239972.587842:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782239972.587884:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602044000/0x8c5345f1c1ec4f7a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e4ca expref: 14 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239972.587907:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bb5d0df4400) 00010000:00010000:3.0:1782239972.587914:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782239972.588314:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27c00/0x8c5345f1c1ec5611 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239972.588941:0:5792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39600/0x8c5345f1c1ec55d2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e683 expref: 5 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239972.588962:0:5792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27c00/0x8c5345f1c1ec5611 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239972.589011:0:5792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39600/0x8c5345f1c1ec55d2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e683 expref: 5 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239972.589029:0:5792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39600/0x8c5345f1c1ec55d2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e683 expref: 5 pid: 5791 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239972.589047:0:5792:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f7811880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5792:1868813758965504:192.168.203.32@tcp:104: 00000100:00100000:3.0:1782239972.589192:0:5792:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5ee3c6900 going to sleep for 11 seconds 00000100:00100000:3.0:1782239972.592289:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239972.592419:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737984000 00000100:00100000:1.0:1782239972.592431:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737984000 00010000:00010000:1.0:1782239972.592502:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39600/0x8c5345f1c1ec55d2 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e683 expref: 6 pid: 5791 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239972.592555:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 59 00000100:00100000:1.0:1782239972.592567:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d021b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f135cc01-3d42-4f2a-80ff-79724f1d3285+6:2344:x1868813737984000:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782239972.592587:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782239972.592595:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39600/0x8c5345f1c1ec55d2 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e683 expref: 6 pid: 5791 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239972.592610:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39600/0x8c5345f1c1ec55d2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e683 expref: 6 pid: 5791 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239972.592658:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bb5d0df4400) 00010000:00010000:1.0:1782239972.592664:0:5777:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27c00/0x8c5345f1c1ec5611 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239972.592674:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27c00/0x8c5345f1c1ec5611 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239972.592683:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27c00/0x8c5345f1c1ec5611 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239972.592706:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782239972.592835:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d021b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f135cc01-3d42-4f2a-80ff-79724f1d3285+6:2344:x1868813737984000:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 269us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239972.592844:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 59 00000100:00080000:3.0:1782239972.594180:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1782239972.599046:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39600/0x8c5345f1c1ec55d2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e683 expref: 5 pid: 5791 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239972.599076:0:5792:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f7811880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5792:1868813758965504:192.168.203.32@tcp:104: 00010000:00010000:2.0:1782239972.599108:0:5792:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27c00/0x8c5345f1c1ec5611 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239972.604051:0:5792:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27c00/0x8c5345f1c1ec5611 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239972.604074:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27c00/0x8c5345f1c1ec5611 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239972.604110:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27400/0x8c5345f1c1ec5618 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239972.604126:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27400/0x8c5345f1c1ec5618 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239972.604139:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27400/0x8c5345f1c1ec5618 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782239972.611139:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1782239972.611937:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27c00/0x8c5345f1c1ec5611 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239972.611962:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27c00/0x8c5345f1c1ec5611 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239972.611970:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27c00/0x8c5345f1c1ec5611 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239972.611979:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f7e27c00 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:3.0:1782239972.611984:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27c00/0x8c5345f1c1ec5611 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239972.611994:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27c00/0x8c5345f1c1ec5611 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239972.612015:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bb5d0df4400) 00010000:00010000:3.0:1782239972.612019:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782239972.612025:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27c00/0x8c5345f1c1ec5611 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239972.612032:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27c00/0x8c5345f1c1ec5611 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782239972.612058:0:5792:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c42773a2 reply state 0000000007d99f2a transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27400/0x8c5345f1c1ec5618 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239972.612070:0:5792:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782239972.612350:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc2a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+15:11314:x1868813737983872:12345-192.168.203.32@tcp:36:lfs.0 Request processed in 24620us (28303us total) trans 4294967416 rc 0/0 00000100:00100000:3.0:1782239972.612376:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 140 00010000:00010000:1.0:1782239972.623475:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27400/0x8c5345f1c1ec5618 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239972.623501:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27400/0x8c5345f1c1ec5618 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239972.623511:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27400/0x8c5345f1c1ec5618 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239972.623518:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f7e27400 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:1.0:1782239972.623524:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27400/0x8c5345f1c1ec5618 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239972.623534:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27400/0x8c5345f1c1ec5618 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239972.623585:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9bb5d0df4e00) 00010000:00010000:1.0:1782239972.623589:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782239972.623595:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27400/0x8c5345f1c1ec5618 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239972.623602:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27400/0x8c5345f1c1ec5618 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239972.767252:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239972.769113:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737984128 00000100:00100000:0.0:1782239972.769131:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737984128 00000100:00100000:0.0:1782239972.769209:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 141 00000100:00100000:0.0:1782239972.769223:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc299c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+14:11322:x1868813737984128:12345-192.168.203.32@tcp:101:lctl.0 00010000:00010000:0.0:1782239972.769257:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782239972.769289:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030800/0x8c5345f1c1ec561f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e698 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239972.769380:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030a00/0x8c5345f1c1ec5626 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239972.769410:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030a00/0x8c5345f1c1ec5626 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239972.769424:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030a00/0x8c5345f1c1ec5626 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782239972.769509:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1782239972.769513:0:5791:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1782239972.769547:0:5791:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030a00/0x8c5345f1c1ec5626 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239972.769577:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030800/0x8c5345f1c1ec561f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e698 expref: 16 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239972.769596:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030a00/0x8c5345f1c1ec5626 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e698 expref: 15 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239972.769615:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bb5c55de500) 00010000:00010000:0.0:1782239972.769618:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782239972.769622:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5c0030a00, rc 0) 00000100:00100000:0.0:1782239972.769711:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc299c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+15:11322:x1868813737984128:12345-192.168.203.32@tcp:101:lctl.0 Request processed in 490us (2476us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239972.769719:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 141 00000100:00100000:3.0:1782239972.899891:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239972.900289:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737984256 00000100:00100000:1.0:1782239972.900303:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737984256 00000100:00100000:1.0:1782239972.900409:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 142 00000100:00100000:1.0:1782239972.900420:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7813480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+15:11328:x1868813737984256:12345-192.168.203.32@tcp:101:bash.0 00010000:00010000:1.0:1782239972.900452:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782239972.900478:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38a00/0x8c5345f1c1ec562d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e69f expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239972.900563:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38c00/0x8c5345f1c1ec5634 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239972.900581:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38c00/0x8c5345f1c1ec5634 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239972.900593:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38c00/0x8c5345f1c1ec5634 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239972.900607:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39800/0x8c5345f1c1ec563b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239972.900614:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39800/0x8c5345f1c1ec563b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239972.900633:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39800/0x8c5345f1c1ec563b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239972.901716:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030800/0x8c5345f1c1ec5642 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239972.901740:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030800/0x8c5345f1c1ec5642 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239972.901800:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030800/0x8c5345f1c1ec5642 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782239972.901870:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:0.0:1782239972.901874:0:5790:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782239972.901899:0:5790:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030800/0x8c5345f1c1ec5642 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239972.901912:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38c00/0x8c5345f1c1ec5634 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239972.901919:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38c00/0x8c5345f1c1ec5634 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239972.901926:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38c00/0x8c5345f1c1ec5634 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239972.901932:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f7e38c00 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:0.0:1782239972.901959:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38c00/0x8c5345f1c1ec5634 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239972.901968:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38c00/0x8c5345f1c1ec5634 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239972.901980:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bb5c55de500) 00010000:00010000:0.0:1782239972.901983:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782239972.901987:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38c00/0x8c5345f1c1ec5634 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239972.901993:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38c00/0x8c5345f1c1ec5634 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239972.902010:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39800/0x8c5345f1c1ec563b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239972.902016:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39800/0x8c5345f1c1ec563b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239972.902022:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39800/0x8c5345f1c1ec563b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239972.902027:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f7e39800 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:0.0:1782239972.902030:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39800/0x8c5345f1c1ec563b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239972.902035:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39800/0x8c5345f1c1ec563b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239972.902043:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9bb5c30e4a00) 00010000:00010000:0.0:1782239972.902045:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782239972.902054:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39800/0x8c5345f1c1ec563b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239972.902059:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39800/0x8c5345f1c1ec563b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239972.902110:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38a00/0x8c5345f1c1ec562d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e69f expref: 17 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239972.902125:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030800/0x8c5345f1c1ec5642 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e69f expref: 16 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239972.902131:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bb5c30e4000) 00010000:00010000:0.0:1782239972.902133:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1782239972.902136:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5c0030800, rc 0) 00000100:00100000:0.0:1782239972.902222:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7813480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+16:11328:x1868813737984256:12345-192.168.203.32@tcp:101:bash.0 Request processed in 1803us (2346us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239972.902231:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 142 00000100:00100000:0.0:1782239972.910633:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239972.911281:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737984512 00000100:00100000:3.0:1782239972.911298:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737984512 00000100:00100000:3.0:1782239972.911381:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 143 00000100:00100000:3.0:1782239972.911395:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc2ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+16:11328:x1868813737984512:12345-192.168.203.32@tcp:101:bash.0 00010000:00010000:3.0:1782239972.911425:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782239972.911453:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27c00/0x8c5345f1c1ec5649 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e6a6 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239972.911631:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26600/0x8c5345f1c1ec5650 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239972.911650:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26600/0x8c5345f1c1ec5650 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239972.911664:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26600/0x8c5345f1c1ec5650 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239972.912964:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27e00/0x8c5345f1c1ec5657 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239972.912988:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27e00/0x8c5345f1c1ec5657 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239972.913001:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27e00/0x8c5345f1c1ec5657 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782239972.925903:0:5791:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:2.0:1782239972.926107:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fe00/0x8c5345f1c1ec565e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239972.926124:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fe00/0x8c5345f1c1ec565e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239972.926136:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fe00/0x8c5345f1c1ec565e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239972.926189:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26600/0x8c5345f1c1ec5650 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239972.926196:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26600/0x8c5345f1c1ec5650 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239972.926203:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26600/0x8c5345f1c1ec5650 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239972.926210:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f7e26600 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:2.0:1782239972.932820:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26600/0x8c5345f1c1ec5650 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239972.932844:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26600/0x8c5345f1c1ec5650 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239972.932868:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bb5c30e4000) 00010000:00010000:2.0:1782239972.932871:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782239972.932877:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26600/0x8c5345f1c1ec5650 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239972.932885:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26600/0x8c5345f1c1ec5650 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782239972.932909:0:5791:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ced676f9 reply state 00000000bda7c4af transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27e00/0x8c5345f1c1ec5657 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239972.932918:0:5791:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1782239972.932987:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27c00/0x8c5345f1c1ec5649 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e6a6 expref: 19 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239972.933028:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fe00/0x8c5345f1c1ec565e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e6a6 expref: 18 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239972.933035:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bb5c4ed6700) 00010000:00010000:2.0:1782239972.933037:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782239972.933040:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5ee29fe00, rc 0) 00000100:00100000:2.0:1782239972.933126:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc2ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+19:11328:x1868813737984512:12345-192.168.203.32@tcp:101:bash.0 Request processed in 21734us (22506us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1782239972.933135:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 143 00010000:00010000:1.0:1782239972.939501:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27e00/0x8c5345f1c1ec5657 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239972.939518:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27e00/0x8c5345f1c1ec5657 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239972.939525:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27e00/0x8c5345f1c1ec5657 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239972.939531:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f7e27e00 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:1.0:1782239972.939535:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27e00/0x8c5345f1c1ec5657 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239972.939543:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27e00/0x8c5345f1c1ec5657 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239972.939561:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bb5d0df4400) 00010000:00010000:1.0:1782239972.939564:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782239972.939570:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27e00/0x8c5345f1c1ec5657 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239972.939576:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27e00/0x8c5345f1c1ec5657 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782239972.945833:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239972.945942:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737984640 00000100:00100000:2.0:1782239972.945961:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737984640 00000100:00100000:2.0:1782239972.946040:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 47 00000100:00100000:2.0:1782239972.946055:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc2aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+5:2344:x1868813737984640:12345-192.168.203.32@tcp:101:bash.0 00000100:00080000:3.0:1782239972.946056:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1782239972.946078:0:6590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782239972.946102:0:6590:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fe246190/0x8c5345f1c1ec566c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e6ad expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782239972.946130:0:6590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782239972.946150:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=352s v=(0 0) 00010000:00010000:2.0:1782239972.946156:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782239972.946167:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe246190/0x8c5345f1c1ec566c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e6ad expref: 6 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239972.946186:0:6590:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fe246190/0x8c5345f1c1ec566c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e6ad expref: 6 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239972.946230:0:6590:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5ee29ee00, rc 0) 00000100:00100000:2.0:1782239972.946298:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc2aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+6:2344:x1868813737984640:12345-192.168.203.32@tcp:101:bash.0 Request processed in 240us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239972.946306:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 47 00000100:00100000:0.0:1782239972.948578:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239972.948674:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737984768 00000100:00100000:2.0:1782239972.948689:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737984768 00000100:00100000:2.0:1782239972.948799:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 48 00000100:00100000:2.0:1782239972.948810:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc2a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+6:11328:x1868813737984768:12345-192.168.203.32@tcp:101:bash.0 00010000:00010000:2.0:1782239972.948829:0:6589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782239972.948847:0:6589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f4fd7be0/0x8c5345f1c1ec5673 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e6b4 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239972.948877:0:6589:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fe246190/0x8c5345f1c1ec566c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e6ad expref: 7 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239972.948886:0:6589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782239972.948890:0:6589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782239972.948896:0:6589:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f4fd7be0/0x8c5345f1c1ec5673 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e6b4 expref: 7 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239972.948929:0:6589:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fe246190/0x8c5345f1c1ec566c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e6ad expref: 7 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239972.948942:0:6589:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fe246190/0x8c5345f1c1ec566c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e6ad expref: 7 pid: 6590 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239972.948983:0:6589:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5e8ecad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6589:1868813758965632:192.168.203.32@tcp:104: 00000100:00100000:2.0:1782239972.949079:0:6589:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c2aa5f00 going to sleep for 11 seconds 00000100:00100000:3.0:1782239972.952702:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239972.952976:0:7481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737984896 00000100:00100000:1.0:1782239972.952991:0:7481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737984896 00010000:00010000:1.0:1782239972.953049:0:7481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fe246190/0x8c5345f1c1ec566c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e6ad expref: 8 pid: 6590 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239972.953123:0:7481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 60 00000100:00100000:1.0:1782239972.953136:0:7481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7812a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+8:2345:x1868813737984896:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782239972.953175:0:7481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782239972.953207:0:7481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fe246190/0x8c5345f1c1ec566c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e6ad expref: 8 pid: 6590 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239972.953225:0:7481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fe246190/0x8c5345f1c1ec566c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e6ad expref: 8 pid: 6590 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239972.953259:0:7481:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782239972.953266:0:7481:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782239972.953278:0:7481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f4fd7be0/0x8c5345f1c1ec5673 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e6b4 expref: 8 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239972.953290:0:7481:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f4fd7be0/0x8c5345f1c1ec5673 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e6b4 expref: 8 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239972.953344:0:7481:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f4fd7be0/0x8c5345f1c1ec5673 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e6b4 expref: 8 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239972.953365:0:7481:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fc29b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7481:1868813758965760:192.168.203.32@tcp:105: 00000100:00100000:1.0:1782239972.953481:0:7481:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c8460d80 going to sleep for 11 seconds 00010000:00010000:2.0:1782239972.953889:0:6589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fe246190/0x8c5345f1c1ec566c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e6ad expref: 8 pid: 6590 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239972.953921:0:6589:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5e8ecad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6589:1868813758965632:192.168.203.32@tcp:104: 00010000:00010000:2.0:1782239972.953962:0:6589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f4fd7be0/0x8c5345f1c1ec5673 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e6b4 expref: 7 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239972.953985:0:6589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5ee29fc00, rc 0) 00000100:00100000:2.0:1782239972.954043:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc2a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+7:11328:x1868813737984768:12345-192.168.203.32@tcp:101:bash.0 Request processed in 5235us (5480us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239972.954053:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 48 00000100:00100000:1.0:1782239972.964724:0:7481:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fc29b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7481:1868813758965760:192.168.203.32@tcp:105: 00010000:00010000:1.0:1782239972.964837:0:7481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782239972.964925:0:7481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7812a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+6:2345:x1868813737984896:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 11779us (12228us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239972.964938:0:7481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 60 00000100:00100000:0.0:1782239972.965464:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239972.965617:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737985152 00000100:00100000:3.0:1782239972.965627:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737985152 00000100:00100000:3.0:1782239972.965689:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 36 00000100:00100000:3.0:1782239972.965700:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc2a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+18:11328:x1868813737985152:12345-192.168.203.32@tcp:35:bash.0 00000001:00080000:3.0:1782239972.966463:0:5793:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967418 00000100:00100000:3.0:1782239972.966598:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc2a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+20:11328:x1868813737985152:12345-192.168.203.32@tcp:35:bash.0 Request processed in 896us (1139us total) trans 4294967419 rc 0/0 00000100:00100000:3.0:1782239972.966606:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 36 00000020:00080000:3.0:1782239972.966612:0:5793:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1782239973.132283:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239973.133522:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737985408 00000100:00100000:3.0:1782239973.133541:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737985408 00000100:00100000:3.0:1782239973.133638:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 144 00000100:00100000:3.0:1782239973.133652:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc2a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+20:11338:x1868813737985408:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:3.0:1782239973.133687:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782239973.133716:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26000/0x8c5345f1c1ec567a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e6bb expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782239973.133940:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1782239973.134111:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26000/0x8c5345f1c1ec567a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e6bb expref: 22 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239973.134130:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bb5c55de500) 00010000:00010000:3.0:1782239973.134133:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782239973.134139:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26000/0x8c5345f1c1ec567a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e6bb expref: 22 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239973.134159:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5f7e26000, rc 0) 00000100:00100000:3.0:1782239973.134239:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc2a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+21:11338:x1868813737985408:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 590us (1965us total) trans 4294967420 rc 301/301 00000100:00100000:3.0:1782239973.134266:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 144 00000100:00100000:0.0:1782239973.139489:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239973.139610:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737985664 00000100:00100000:2.0:1782239973.139622:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737985664 00000100:00100000:2.0:1782239973.139696:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 37 00000100:00100000:2.0:1782239973.139709:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc2aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+21:11338:x1868813737985664:12345-192.168.203.32@tcp:35:lfs.0 00000100:00100000:2.0:1782239973.140128:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc2aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+22:11338:x1868813737985664:12345-192.168.203.32@tcp:35:lfs.0 Request processed in 420us (653us total) trans 4294967421 rc 0/0 00000100:00100000:2.0:1782239973.140137:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 37 00000100:00100000:1.0:1782239973.239070:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239973.239385:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737985792 00000100:00100000:0.0:1782239973.239400:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737985792 00000100:00100000:0.0:1782239973.239489:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 145 00000100:00100000:0.0:1782239973.239501:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc29b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+22:11344:x1868813737985792:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:0.0:1782239973.239534:0:6611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782239973.239576:0:6611:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031e00/0x8c5345f1c1ec5688 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e6c2 expref: -99 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239973.239663:0:6611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030e00/0x8c5345f1c1ec568f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239973.239887:0:6611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030e00/0x8c5345f1c1ec568f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239973.239903:0:6611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030e00/0x8c5345f1c1ec568f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782239973.240103:0:6611:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:0.0:1782239973.240107:0:6611:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1782239973.240136:0:6611:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030e00/0x8c5345f1c1ec568f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239973.240171:0:6611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031e00/0x8c5345f1c1ec5688 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e6c2 expref: 24 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239973.240195:0:6611:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030e00/0x8c5345f1c1ec568f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e6c2 expref: 23 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239973.240205:0:6611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bb5c30e4000) 00010000:00010000:0.0:1782239973.240208:0:6611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782239973.240212:0:6611:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5c0030e00, rc 0) 00000100:00100000:0.0:1782239973.240297:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc29b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+23:11344:x1868813737985792:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 798us (1241us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239973.240305:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 145 00000100:00100000:3.0:1782239973.246527:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239973.246911:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737986048 00000100:00100000:1.0:1782239973.246927:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737986048 00000100:00100000:1.0:1782239973.247036:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 146 00000100:00100000:1.0:1782239973.247049:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7810380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+23:11344:x1868813737986048:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:1.0:1782239973.247080:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782239973.247109:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38c00/0x8c5345f1c1ec5696 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e6c9 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239973.247263:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39200/0x8c5345f1c1ec569d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239973.247282:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39200/0x8c5345f1c1ec569d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239973.247296:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39200/0x8c5345f1c1ec569d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782239973.247310:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1782239973.248106:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38c00/0x8c5345f1c1ec5696 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e6c9 expref: 26 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239973.248133:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39200/0x8c5345f1c1ec569d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e6c9 expref: 25 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239973.248167:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bb5c4ed6700) 00010000:00010000:1.0:1782239973.248171:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782239973.248175:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5f7e39200, rc 0) 00000100:00100000:1.0:1782239973.248710:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7810380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+25:11344:x1868813737986048:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 1659us (2200us total) trans 4294967422 rc 0/0 00000100:00100000:1.0:1782239973.248721:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 146 00000100:00100000:2.0:1782239973.259874:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239973.259945:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737986176 00000100:00100000:2.0:1782239973.259969:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737986176 00000100:00100000:2.0:1782239973.260071:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 10 00000100:00100000:2.0:1782239973.260082:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8ecad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+25:2347:x1868813737986176:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782239973.260104:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782239973.260139:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39200/0x8c5345f1c1ec569d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e6c9 expref: 25 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239973.260162:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bb5c4ed6700) 00010000:00010000:2.0:1782239973.260168:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782239973.260242:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8ecad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+24:2347:x1868813737986176:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 162us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239973.260250:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 10 00000100:00100000:3.0:1782239973.269579:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239973.278817:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737986432 00000100:00100000:2.0:1782239973.278840:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737986432 00000100:00100000:2.0:1782239973.278924:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 147 00000100:00100000:2.0:1782239973.278935:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7810a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+24:11344:x1868813737986432:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:2.0:1782239973.278989:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782239973.279020:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ee00/0x8c5345f1c1ec56ab lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e6d0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239973.279153:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec56b2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239973.279171:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec56b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239973.279185:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec56b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782239973.279201:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1782239973.280959:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ee00/0x8c5345f1c1ec56ab lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e6d0 expref: 27 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239973.281005:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec56b2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e6d0 expref: 26 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239973.281016:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bb5c4ed6700) 00010000:00010000:2.0:1782239973.281019:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1782239973.281024:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5ee29ea00, rc 0) 00000100:00100000:2.0:1782239973.281185:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7810a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+26:11344:x1868813737986432:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 2250us (11623us total) trans 4294967423 rc 0/0 00000100:00100000:2.0:1782239973.281197:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 147 00000100:00100000:0.0:1782239973.298898:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239973.299044:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737986560 00000100:00100000:2.0:1782239973.299059:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737986560 00000100:00100000:2.0:1782239973.299137:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 49 00000100:00100000:2.0:1782239973.299149:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc2ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+6:2344:x1868813737986560:12345-192.168.203.32@tcp:1:lfs.0 00010000:00010000:2.0:1782239973.299212:0:6590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe246190/0x8c5345f1c1ec56c0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239973.299248:0:6590:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f4fd7be0/0x8c5345f1c1ec5673 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e6b4 expref: 6 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239973.299259:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782239973.299263:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782239973.299268:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe246190/0x8c5345f1c1ec56c0 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239973.299315:0:6590:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f4fd7be0/0x8c5345f1c1ec5673 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e6b4 expref: 6 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239973.299340:0:6590:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f4fd7be0/0x8c5345f1c1ec5673 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e6b4 expref: 6 pid: 6589 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239973.299359:0:6590:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5e8ecbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6590:1868813758965888:192.168.203.32@tcp:104: 00000100:00100000:2.0:1782239973.299495:0:6590:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c2aa5900 going to sleep for 11 seconds 00000100:00100000:2.0:1782239973.301906:0:6590:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5e8ecbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6590:1868813758965888:192.168.203.32@tcp:104: 00010000:00010000:2.0:1782239973.301956:0:6590:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fe246190/0x8c5345f1c1ec56c0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782239973.302643:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239973.302789:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737986688 00000100:00100000:2.0:1782239973.302802:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737986688 00002000:00100000:2.0:1782239973.302871:0:6595:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9bb5fc2aad80 x1868813737986688/t0(0) o4->36dd742b-25b8-431e-bf41-75f2fff47ffb@192.168.203.32@tcp:574/0 lens 504/0 e 0 to 0 dl 1782239984 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782239973.302885:0:6595:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9bb5fc2aad80 with x1868813737986688 ext(0->12) 00010000:00010000:2.0:1782239973.302895:0:6595:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f4fd7be0/0x8c5345f1c1ec5673 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e6b4 expref: 7 pid: 6589 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239973.302913:0:6595:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f4fd7be0/0x8c5345f1c1ec5673 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e6b4 expref: 7 pid: 6589 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782239973.302922:0:6595:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9bb5fc2aad80 00000100:00100000:2.0:1782239973.302972:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 2 00000100:00100000:2.0:1782239973.302984:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc2aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+7:2344:x1868813737986688:12345-192.168.203.32@tcp:4:lfs.0 00000100:00100000:2.0:1782239973.303668:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc2aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+9:2344:x1868813737986688:12345-192.168.203.32@tcp:4:lfs.0 Request processed in 681us (1035us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1782239973.303678:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 2 00002000:00100000:2.0:1782239973.303688:0:6595:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9bb5fc2aad80 x1868813737986688/t4294967305(0) o4->36dd742b-25b8-431e-bf41-75f2fff47ffb@192.168.203.32@tcp:574/0 lens 504/448 e 0 to 0 dl 1782239984 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782239973.303698:0:6595:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9bb5fc2aad80 with x1868813737986688 ext(0->12) 00010000:00010000:2.0:1782239973.303706:0:6595:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f4fd7be0/0x8c5345f1c1ec5673 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e6b4 expref: 9 pid: 6589 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239973.303720:0:6595:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f4fd7be0/0x8c5345f1c1ec5673 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e6b4 expref: 9 pid: 6589 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782239973.303728:0:6595:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9bb5fc2aad80 00000100:00100000:1.0:1782239973.307452:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239973.307611:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737986816 00000100:00100000:3.0:1782239973.307624:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737986816 00010000:00010000:3.0:1782239973.307691:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f4fd7be0/0x8c5345f1c1ec5673 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e6b4 expref: 9 pid: 6589 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239973.307743:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 61 00000100:00100000:3.0:1782239973.307804:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc298000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+9:2346:x1868813737986816:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782239973.307824:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1782239973.307851:0:5776:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1782239973.307854:0:5776:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1782239973 00002000:00010000:3.0:1782239973.307857:0:5776:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1782239973 00002000:00010000:3.0:1782239973.307859:0:5776:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1782239973 00010000:00010000:3.0:1782239973.307866:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f4fd7be0/0x8c5345f1c1ec5673 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e6b4 expref: 9 pid: 6589 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239973.307882:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f4fd7be0/0x8c5345f1c1ec5673 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e6b4 expref: 9 pid: 6589 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239973.307913:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f4fd7be0/0x8c5345f1c1ec5673 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e6b4 expref: 9 pid: 6589 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239973.307935:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782239973.307940:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782239973.307975:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fe246190/0x8c5345f1c1ec56c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239973.307987:0:5776:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe246190/0x8c5345f1c1ec56c0 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239973.308031:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782239973.308102:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc298000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+8:2346:x1868813737986816:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 301us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239973.308117:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 61 00010000:00010000:2.0:1782239973.308619:0:6590:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fe246190/0x8c5345f1c1ec56c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239973.308632:0:6590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fe246190/0x8c5345f1c1ec56c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239973.308666:0:6590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe246190/0x8c5345f1c1ec56c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239973.308676:0:6590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fe246190/0x8c5345f1c1ec56c0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239973.308700:0:6590:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fe246190/0x8c5345f1c1ec56c0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239973.308708:0:6590:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5ee29ee00 already unused, calling callback (ffffffffc1728ce0) 00010000:00010000:2.0:1782239973.308713:0:6590:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe246190/0x8c5345f1c1ec56c0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239973.308723:0:6590:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe246190/0x8c5345f1c1ec56c0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239973.308739:0:6590:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fe246190/0x8c5345f1c1ec56c0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239973.308778:0:6590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fe246190/0x8c5345f1c1ec56c0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239973.308921:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc2ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+7:2344:x1868813737986560:12345-192.168.203.32@tcp:1:lfs.0 Request processed in 9772us (10036us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239973.308931:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 49 00000100:00100000:1.0:1782239973.330348:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239973.330519:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737987072 00000100:00100000:2.0:1782239973.330532:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737987072 00000100:00100000:2.0:1782239973.330609:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 38 00000100:00100000:2.0:1782239973.330622:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5c779d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+26:11344:x1868813737987072:12345-192.168.203.32@tcp:35:lfs.0 00000004:00010000:2.0:1782239973.330718:0:5794:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec56b2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e6d0 expref: 26 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782239973.331125:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:2.0:1782239973.331178:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:1.0:1782239973.332126:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00010000:00010000:1.0:1782239973.332215:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39600/0x8c5345f1c1ec56c7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239973.332238:0:5794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fe00/0x8c5345f1c1ec565e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e6a6 expref: 30 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239973.332249:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39600/0x8c5345f1c1ec56c7 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239973.332298:0:5794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fe00/0x8c5345f1c1ec565e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e6a6 expref: 30 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239973.332318:0:5794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fe00/0x8c5345f1c1ec565e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e6a6 expref: 30 pid: 5791 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239973.332335:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fc299f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5794:1868813758966016:192.168.203.32@tcp:104: 00000100:00100000:1.0:1782239973.332453:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c8460b40 going to sleep for 11 seconds 00000100:00100000:0.0:1782239973.340332:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239973.340702:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737987200 00000100:00100000:2.0:1782239973.340717:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737987200 00010000:00010000:2.0:1782239973.340813:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fe00/0x8c5345f1c1ec565e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e6a6 expref: 31 pid: 5791 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239973.340870:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 62 00000100:00100000:2.0:1782239973.340882:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc2a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+31:2345:x1868813737987200:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782239973.340902:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782239973.340911:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fe00/0x8c5345f1c1ec565e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e6a6 expref: 31 pid: 5791 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239973.340927:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fe00/0x8c5345f1c1ec565e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e6a6 expref: 31 pid: 5791 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239973.340968:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bb5c4ed6700) 00010000:00010000:2.0:1782239973.340980:0:5777:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39600/0x8c5345f1c1ec56c7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239973.340992:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39600/0x8c5345f1c1ec56c7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239973.341001:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39600/0x8c5345f1c1ec56c7 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239973.341024:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782239973.341092:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc2a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+31:2345:x1868813737987200:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 211us (774us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239973.341116:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 62 00010000:00010000:1.0:1782239973.341696:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fe00/0x8c5345f1c1ec565e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e6a6 expref: 30 pid: 5791 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239973.341719:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fc299f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5794:1868813758966016:192.168.203.32@tcp:104: 00010000:00010000:1.0:1782239973.341788:0:5794:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39600/0x8c5345f1c1ec56c7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239973.341800:0:5794:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39600/0x8c5345f1c1ec56c7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239973.341807:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39600/0x8c5345f1c1ec56c7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782239973.342139:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000001:00080000:1.0:1782239973.343721:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:1.0:1782239973.347654:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fc299f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5794:1868813758966144:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1782239973.347780:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239973.347830:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c8460780 going to sleep for 11 seconds 00000100:00100000:3.0:1782239973.348336:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758966144 00000100:00100000:3.0:1782239973.348347:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758966144 00000100:00100000:3.0:1782239973.348448:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1782239973.348459:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc299880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5794:x1868813758966144:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1782239973.348581:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc299880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5794:x1868813758966144:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 123us (800us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239973.348590:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1782239973.348718:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782239973.348996:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fc299f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5794:1868813758966144:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1782239973.350138:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:1.0:1782239973.350379:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fc299f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5794:1868813758966272:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1782239973.350568:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239973.350611:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5d1bb3a80 going to sleep for 11 seconds 00000100:00100000:3.0:1782239973.350745:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758966272 00000100:00100000:3.0:1782239973.350783:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758966272 00000100:00100000:3.0:1782239973.350839:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1782239973.350849:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f46fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5794:x1868813758966272:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1782239973.351275:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f46fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5794:x1868813758966272:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 426us (707us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1782239973.351285:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1782239973.351621:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fc299f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5794:1868813758966272:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1782239973.351703:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:1.0:1782239973.351923:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39600/0x8c5345f1c1ec56c7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239973.351935:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39600/0x8c5345f1c1ec56c7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239973.351966:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39600/0x8c5345f1c1ec56c7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239973.352086:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f7e39600 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:1.0:1782239973.352092:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39600/0x8c5345f1c1ec56c7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239973.352102:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39600/0x8c5345f1c1ec56c7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239973.352125:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bb5c4ed6700) 00010000:00010000:1.0:1782239973.352129:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1782239973.352135:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39600/0x8c5345f1c1ec56c7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239973.352142:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39600/0x8c5345f1c1ec56c7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782239973.352639:0:5794:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1782239973.353131:0:5794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:1.0:1782239973.353148:0:5794:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 352425399321ns, next at 353425395961ns, rc = 0 00000001:00080000:1.0:1782239973.353159:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:1.0:1782239973.353220:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bb5c4ed6700) 00010000:00010000:1.0:1782239973.353224:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1782239973.353235:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec56b2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e6d0 expref: 34 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239973.353866:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5c779d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+33:11344:x1868813737987072:12345-192.168.203.32@tcp:35:lfs.0 Request processed in 23243us (23528us total) trans 4294967432 rc 0/0 00000100:00100000:1.0:1782239973.353899:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 38 00000020:00080000:1.0:1782239973.353906:0:5794:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1782239973.359704:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239973.359955:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737987328 00000100:00100000:3.0:1782239973.359969:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737987328 00000100:00100000:3.0:1782239973.360055:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 148 00000100:00100000:3.0:1782239973.360068:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f46fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+33:11344:x1868813737987328:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:3.0:1782239973.360120:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782239973.360152:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26000/0x8c5345f1c1ec56ce lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e6d7 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239973.360526:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26000/0x8c5345f1c1ec56ce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e6d7 expref: 34 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239973.360546:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26000/0x8c5345f1c1ec56ce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e6d7 expref: 34 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239973.360573:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bb5d0df4500) 00010000:00010000:3.0:1782239973.360576:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782239973.360580:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5f7e26000, rc 0) 00000100:00100000:3.0:1782239973.360664:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f46fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+34:11344:x1868813737987328:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 598us (976us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239973.360673:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 148 00000100:00100000:2.0:1782239973.366624:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239973.366734:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737987584 00000100:00100000:3.0:1782239973.366779:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737987584 00000100:00100000:3.0:1782239973.366860:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 39 00000100:00100000:3.0:1782239973.366873:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8ecbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+34:11344:x1868813737987584:12345-192.168.203.32@tcp:35:lfs.0 00000100:00100000:3.0:1782239973.367314:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8ecbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+35:11344:x1868813737987584:12345-192.168.203.32@tcp:35:lfs.0 Request processed in 443us (704us total) trans 4294967433 rc 0/0 00000100:00100000:3.0:1782239973.367511:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 39 00000100:00100000:1.0:1782239973.468626:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239973.469047:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737987840 00000100:00100000:0.0:1782239973.469062:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737987840 00000100:00100000:0.0:1782239973.469196:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 149 00000100:00100000:0.0:1782239973.469210:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f46fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+35:11354:x1868813737987840:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:0.0:1782239973.469255:0:6611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782239973.469290:0:6611:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437c00/0x8c5345f1c1ec56d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e6de expref: -99 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782239973.469474:0:6611:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1782239973.470848:0:6611:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437c00/0x8c5345f1c1ec56d5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e6de expref: 37 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239973.470872:0:6611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bb5c55de500) 00010000:00010000:0.0:1782239973.470876:0:6611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782239973.470884:0:6611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437c00/0x8c5345f1c1ec56d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e6de expref: 37 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239973.471163:0:6611:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5f4437c00, rc 0) 00000100:00100000:0.0:1782239973.471830:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f46fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+36:11354:x1868813737987840:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 2617us (3213us total) trans 4294967434 rc 301/301 00000100:00100000:0.0:1782239973.471844:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 149 00000100:00100000:1.0:1782239973.475367:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239973.475858:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737987968 00000100:00100000:0.0:1782239973.475872:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737987968 00000100:00100000:0.0:1782239973.475979:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 150 00000100:00100000:0.0:1782239973.475992:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f46fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+36:11354:x1868813737987968:12345-192.168.203.32@tcp:34:lfs.0 00010000:00010000:0.0:1782239973.476127:0:6611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437400/0x8c5345f1c1ec56e3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239973.476148:0:6611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437400/0x8c5345f1c1ec56e3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239973.476163:0:6611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437400/0x8c5345f1c1ec56e3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239973.476181:0:6611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437e00/0x8c5345f1c1ec56ea lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239973.476189:0:6611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437e00/0x8c5345f1c1ec56ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239973.476197:0:6611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437e00/0x8c5345f1c1ec56ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239973.476823:0:6611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436000/0x8c5345f1c1ec56f1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239973.476836:0:6611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436000/0x8c5345f1c1ec56f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239973.476844:0:6611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436000/0x8c5345f1c1ec56f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782239973.476905:0:6611:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436000/0x8c5345f1c1ec56f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239973.476921:0:6611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437400/0x8c5345f1c1ec56e3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239973.476943:0:6611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437400/0x8c5345f1c1ec56e3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239973.476961:0:6611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437400/0x8c5345f1c1ec56e3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239973.476968:0:6611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f4437400 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:0.0:1782239973.477115:0:6611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437400/0x8c5345f1c1ec56e3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239973.477126:0:6611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437400/0x8c5345f1c1ec56e3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239973.477142:0:6611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bb5c30e4000) 00010000:00010000:0.0:1782239973.477145:0:6611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782239973.477151:0:6611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437400/0x8c5345f1c1ec56e3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239973.477157:0:6611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437400/0x8c5345f1c1ec56e3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239973.477174:0:6611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437e00/0x8c5345f1c1ec56ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239973.477180:0:6611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437e00/0x8c5345f1c1ec56ea lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239973.477185:0:6611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437e00/0x8c5345f1c1ec56ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239973.477190:0:6611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f4437e00 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:0.0:1782239973.477200:0:6611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437e00/0x8c5345f1c1ec56ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239973.477207:0:6611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437e00/0x8c5345f1c1ec56ea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239973.477288:0:6611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bb5c55de100) 00010000:00010000:0.0:1782239973.477292:0:6611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782239973.477295:0:6611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437e00/0x8c5345f1c1ec56ea lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239973.477302:0:6611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437e00/0x8c5345f1c1ec56ea lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239973.477635:0:6611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436000/0x8c5345f1c1ec56f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239973.477710:0:6611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436000/0x8c5345f1c1ec56f1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239973.477718:0:6611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436000/0x8c5345f1c1ec56f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239973.477723:0:6611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f4436000 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:0.0:1782239973.477727:0:6611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436000/0x8c5345f1c1ec56f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239973.477733:0:6611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436000/0x8c5345f1c1ec56f1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239973.477744:0:6611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bb5d0df4500) 00010000:00010000:0.0:1782239973.477777:0:6611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782239973.477790:0:6611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436000/0x8c5345f1c1ec56f1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239973.477796:0:6611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436000/0x8c5345f1c1ec56f1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782239973.477992:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f46fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+36:11354:x1868813737987968:12345-192.168.203.32@tcp:34:lfs.0 Request processed in 1997us (2634us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239973.478003:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 150 00000100:00100000:3.0:1782239973.486387:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239973.491126:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737988224 00000100:00100000:2.0:1782239973.491147:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737988224 00000100:00100000:2.0:1782239973.493101:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 40 00000100:00100000:2.0:1782239973.493130:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7810700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+36:11354:x1868813737988224:12345-192.168.203.32@tcp:35:lfs.0 00000100:00100000:2.0:1782239973.493735:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7810700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+37:11354:x1868813737988224:12345-192.168.203.32@tcp:35:lfs.0 Request processed in 616us (7359us total) trans 4294967435 rc 0/0 00000100:00100000:2.0:1782239973.493745:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 40 00000100:00100000:1.0:1782239973.563978:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239973.564084:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737988480 00000100:00100000:2.0:1782239973.564098:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737988480 00000100:00100000:2.0:1782239973.564174:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 151 00000100:00100000:2.0:1782239973.564186:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f46ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+37:11357:x1868813737988480:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:2.0:1782239973.564293:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782239973.564396:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fa00/0x8c5345f1c1ec56f8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e6e5 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239973.564787:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e800/0x8c5345f1c1ec56ff lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239973.564806:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e800/0x8c5345f1c1ec56ff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239973.564820:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e800/0x8c5345f1c1ec56ff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239973.564837:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e000/0x8c5345f1c1ec5706 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239973.564864:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e000/0x8c5345f1c1ec5706 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239973.564872:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e000/0x8c5345f1c1ec5706 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239973.566033:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec570d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239973.566052:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec570d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239973.566062:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec570d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782239973.566077:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1782239973.566206:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e800/0x8c5345f1c1ec56ff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239973.567005:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e800/0x8c5345f1c1ec56ff lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239973.567022:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e800/0x8c5345f1c1ec56ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239973.567028:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5ee29e800 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:2.0:1782239973.567033:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e800/0x8c5345f1c1ec56ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239973.567041:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e800/0x8c5345f1c1ec56ff lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239973.567082:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bb5c30e4000) 00010000:00010000:2.0:1782239973.567085:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782239973.567090:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e800/0x8c5345f1c1ec56ff lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239973.567097:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e800/0x8c5345f1c1ec56ff lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239973.567117:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e000/0x8c5345f1c1ec5706 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239973.567123:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e000/0x8c5345f1c1ec5706 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239973.567129:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e000/0x8c5345f1c1ec5706 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239973.567134:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5ee29e000 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:2.0:1782239973.567136:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e000/0x8c5345f1c1ec5706 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239973.567141:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e000/0x8c5345f1c1ec5706 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239973.567148:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bb5c4ed6400) 00010000:00010000:2.0:1782239973.567150:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782239973.567153:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e000/0x8c5345f1c1ec5706 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239973.567158:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e000/0x8c5345f1c1ec5706 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239973.568155:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fa00/0x8c5345f1c1ec56f8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e6e5 expref: 40 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239973.568192:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec570d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e6e5 expref: 39 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239973.568201:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bb5d0df4500) 00010000:00010000:2.0:1782239973.568203:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782239973.568207:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5ee29ea00, rc 0) 00000100:00100000:2.0:1782239973.568329:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f46ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+39:11357:x1868813737988480:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 4144us (4442us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1782239973.568341:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 151 00000100:00100000:3.0:1782239973.575109:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239973.575394:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737988608 00000100:00100000:0.0:1782239973.575410:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737988608 00000100:00100000:0.0:1782239973.575495:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 152 00000100:00100000:0.0:1782239973.575516:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7812300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+39:11357:x1868813737988608:12345-192.168.203.32@tcp:54:lfs.0 00010000:00010000:0.0:1782239973.575607:0:6611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436000/0x8c5345f1c1ec571b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239973.575630:0:6611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436000/0x8c5345f1c1ec571b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239973.575654:0:6611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436000/0x8c5345f1c1ec571b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239973.575690:0:6611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436000/0x8c5345f1c1ec571b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239973.575698:0:6611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436000/0x8c5345f1c1ec571b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239973.575705:0:6611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436000/0x8c5345f1c1ec571b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239973.575711:0:6611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f4436000 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:0.0:1782239973.575732:0:6611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436000/0x8c5345f1c1ec571b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239973.575741:0:6611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436000/0x8c5345f1c1ec571b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239973.575783:0:6611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bb5d0df4500) 00010000:00010000:0.0:1782239973.575786:0:6611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782239973.575792:0:6611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436000/0x8c5345f1c1ec571b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239973.575798:0:6611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436000/0x8c5345f1c1ec571b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782239973.575892:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7812300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+39:11357:x1868813737988608:12345-192.168.203.32@tcp:54:lfs.0 Request processed in 387us (798us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239973.575915:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 152 00000100:00100000:3.0:1782239973.585179:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239973.585495:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737988864 00000100:00100000:0.0:1782239973.585509:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737988864 00000100:00100000:0.0:1782239973.585577:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 41 00000100:00100000:0.0:1782239973.585588:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7811500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+39:11357:x1868813737988864:12345-192.168.203.32@tcp:35:lfs.0 00000100:00100000:0.0:1782239973.585939:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7811500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+40:11357:x1868813737988864:12345-192.168.203.32@tcp:35:lfs.0 Request processed in 348us (769us total) trans 4294967437 rc 0/0 00000100:00100000:0.0:1782239973.585957:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 41 00010000:00010000:3.0:1782239973.599052:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782239973.666288:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782239973.666334:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5e8ec9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1868813758966400:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782239973.666451:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239973.667231:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758966400 00000100:00100000:2.0:1782239973.667247:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758966400 00000100:00100000:2.0:1782239973.667354:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1782239973.667367:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7810e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1868813758966400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782239973.667422:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782239973.667500:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7810e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1868813758966400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 136us (1050us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239973.667508:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:3.0:1782239973.672570:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782239973.672696:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5e8ec9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1868813758966400:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782239973.952203:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239973.952305:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737989120 00000100:00100000:1.0:1782239973.952319:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737989120 00000100:00100000:1.0:1782239973.952399:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 153 00000100:00100000:1.0:1782239973.952412:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8ec8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+40:11388:x1868813737989120:12345-192.168.203.32@tcp:101:cat.0 00010000:00010000:1.0:1782239973.952447:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782239973.952476:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38400/0x8c5345f1c1ec5722 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e6ec expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239973.952621:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39400/0x8c5345f1c1ec5729 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239973.952637:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39400/0x8c5345f1c1ec5729 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239973.952653:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39400/0x8c5345f1c1ec5729 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782239973.952668:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1782239973.952858:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38400/0x8c5345f1c1ec5722 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e6ec expref: 43 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239973.952879:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39400/0x8c5345f1c1ec5729 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e6ec expref: 42 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239973.952905:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bb5d0df4500) 00010000:00010000:1.0:1782239973.952908:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782239973.952912:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5f7e39400, rc 0) 00000100:00100000:1.0:1782239973.953000:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8ec8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+42:11388:x1868813737989120:12345-192.168.203.32@tcp:101:cat.0 Request processed in 590us (810us total) trans 4294967438 rc 0/0 00000100:00100000:1.0:1782239973.953008:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 153 00000100:00100000:3.0:1782239973.957706:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239973.957969:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737989248 00000100:00100000:0.0:1782239973.957984:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737989248 00000100:00100000:0.0:1782239973.958066:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 11 00000100:00100000:0.0:1782239973.958079:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7813b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+42:2344:x1868813737989248:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782239973.958104:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782239973.958156:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39400/0x8c5345f1c1ec5729 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e6ec expref: 42 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239973.958179:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bb5d0df4500) 00010000:00010000:0.0:1782239973.958186:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782239973.958263:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7813b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+41:2344:x1868813737989248:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 187us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239973.958272:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 11 00000100:00100000:3.0:1782239973.965514:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239973.965714:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737989504 00000100:00100000:0.0:1782239973.965728:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737989504 00000100:00100000:0.0:1782239973.965842:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 42 00000100:00100000:0.0:1782239973.965854:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7811880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+41:11388:x1868813737989504:12345-192.168.203.32@tcp:35:cat.0 00000100:00100000:0.0:1782239973.966207:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7811880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+42:11388:x1868813737989504:12345-192.168.203.32@tcp:35:cat.0 Request processed in 354us (704us total) trans 4294967439 rc 0/0 00000100:00100000:0.0:1782239973.966216:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 42 00000100:00100000:2.0:1782239974.046193:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239974.046282:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737989760 00000100:00100000:0.0:1782239974.046295:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737989760 00000100:00100000:0.0:1782239974.046387:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 154 00000100:00100000:0.0:1782239974.046399:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8ec9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+42:11394:x1868813737989760:12345-192.168.203.32@tcp:101:dd.0 00010000:00010000:0.0:1782239974.046617:0:6611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:2.0:1782239974.046619:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1782239974.046622:0:6611:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1782239974.046743:0:6611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030e00/0x8c5345f1c1ec568f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e6c2 expref: 42 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239974.046886:0:6611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bb5c30e4000) 00010000:00010000:0.0:1782239974.046892:0:6611:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782239974.046908:0:6611:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436000/0x8c5345f1c1ec5737 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e6f3 expref: -99 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239974.047080:0:6611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437e00/0x8c5345f1c1ec573e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239974.047096:0:6611:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec570d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e6e5 expref: 42 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239974.047106:0:6611:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437e00/0x8c5345f1c1ec573e lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239974.047214:0:6611:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec570d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e6e5 expref: 42 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239974.047231:0:6611:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec570d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e6e5 expref: 42 pid: 5791 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239974.047246:0:6611:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fbf24380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6611:1868813758966528:192.168.203.32@tcp:104: 00000100:00100000:1.0:1782239974.047377:0:6611:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c8460b40 going to sleep for 11 seconds 00000100:00100000:0.0:1782239974.059972:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239974.060039:0:6611:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fbf24380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6611:1868813758966528:192.168.203.32@tcp:104: 00010000:00010000:1.0:1782239974.060078:0:6611:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437e00/0x8c5345f1c1ec573e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239974.060207:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737989888 00000100:00100000:3.0:1782239974.060227:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737989888 00010000:00010000:3.0:1782239974.060273:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec570d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e6e5 expref: 43 pid: 5791 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239974.060321:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 63 00000100:00100000:3.0:1782239974.060331:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc2aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+43:2345:x1868813737989888:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782239974.060349:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782239974.060356:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec570d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e6e5 expref: 43 pid: 5791 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239974.060370:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec570d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e6e5 expref: 43 pid: 5791 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239974.060398:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec570d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e6e5 expref: 43 pid: 5791 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239974.060418:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bb5d0df4500) 00010000:00010000:3.0:1782239974.060424:0:5777:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437e00/0x8c5345f1c1ec573e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239974.060468:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437e00/0x8c5345f1c1ec573e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239974.060478:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437e00/0x8c5345f1c1ec573e lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239974.060704:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782239974.060801:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc2aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+42:2345:x1868813737989888:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 469us (841us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239974.060809:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 63 00010000:00010000:1.0:1782239974.066469:0:6611:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437e00/0x8c5345f1c1ec573e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239974.066492:0:6611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437e00/0x8c5345f1c1ec573e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782239974.066523:0:6611:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1782239974.066930:0:6611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436000/0x8c5345f1c1ec5737 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e6f3 expref: 43 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239974.067077:0:6611:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437e00/0x8c5345f1c1ec573e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e6f3 expref: 42 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239974.067086:0:6611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bb5d0df4500) 00010000:00010000:1.0:1782239974.067090:0:6611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1782239974.067094:0:6611:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5f4437e00, rc 0) 00000100:00100000:1.0:1782239974.067186:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8ec9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+42:11394:x1868813737989760:12345-192.168.203.32@tcp:101:dd.0 Request processed in 20788us (21007us total) trans 4294967440 rc 0/0 00000100:00100000:1.0:1782239974.067198:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 154 00000100:00100000:0.0:1782239974.075892:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239974.076004:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737990144 00000100:00100000:1.0:1782239974.076018:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737990144 00000100:00100000:1.0:1782239974.076103:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 155 00000100:00100000:1.0:1782239974.076116:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc2a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+42:11394:x1868813737990144:12345-192.168.203.32@tcp:36:dd.0 00010000:00010000:1.0:1782239974.077426:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38400/0x8c5345f1c1ec574c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239974.077453:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38400/0x8c5345f1c1ec574c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239974.077467:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38400/0x8c5345f1c1ec574c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782239974.077622:0:5790:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967441 00000004:00010000:1.0:1782239974.077664:0:5790:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009b646688 reply state 000000000f351726 transno 4294967442 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38400/0x8c5345f1c1ec574c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239974.077674:0:5790:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782239974.077853:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc2a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+45:11394:x1868813737990144:12345-192.168.203.32@tcp:36:dd.0 Request processed in 1737us (1973us total) trans 4294967442 rc 0/0 00000100:00100000:1.0:1782239974.077863:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 155 00000020:00080000:1.0:1782239974.077870:0:5790:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1782239974.083651:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38400/0x8c5345f1c1ec574c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239974.083678:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38400/0x8c5345f1c1ec574c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239974.083687:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38400/0x8c5345f1c1ec574c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239974.083694:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f7e38400 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:1.0:1782239974.083700:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38400/0x8c5345f1c1ec574c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239974.083709:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38400/0x8c5345f1c1ec574c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239974.083735:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bb5d0df4500) 00010000:00010000:1.0:1782239974.083738:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782239974.083744:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38400/0x8c5345f1c1ec574c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239974.084006:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38400/0x8c5345f1c1ec574c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782239974.420689:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239974.420741:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239974.420812:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239974.420854:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239974.420856:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737990656 00000100:00100000:2.0:1782239974.420875:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737990656 00000100:00100000:0.0:1782239974.420887:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239974.420930:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737990400 00000100:00100000:0.0:1782239974.420951:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737990400 00000100:00100000:2.0:1782239974.420989:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737990528 00000100:00100000:2.0:1782239974.421013:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737990528 00000100:00100000:0.0:1782239974.421031:0:8312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 92 00000100:00100000:0.0:1782239974.421047:0:8312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc08f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+7:2344:x1868813737990656:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:2.0:1782239974.421062:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 93 00000100:00100000:2.0:1782239974.421075:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc08d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+6:2344:x1868813737990528:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:0.0:1782239974.421134:0:8312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc08f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+7:2344:x1868813737990656:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 89us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239974.421143:0:8312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 92 00000100:00100000:2.0:1782239974.421155:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc08d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+6:2344:x1868813737990528:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 80us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239974.421166:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 93 00000100:00100000:0.0:1782239974.421177:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737990784 00000100:00100000:0.0:1782239974.421184:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737990784 00000100:00100000:3.0:1782239974.421269:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737990272 00000100:00100000:3.0:1782239974.421274:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737990272 00000100:00100000:3.0:1782239974.421478:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 296 00000100:00100000:3.0:1782239974.421486:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5decbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afaefb1a-536b-42a3-a3ff-47200f8611c3+13:2344:x1868813737990272:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:3.0:1782239974.421524:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5decbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afaefb1a-536b-42a3-a3ff-47200f8611c3+13:2344:x1868813737990272:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 39us (715us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239974.421531:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 296 00000100:00080000:3.0:1782239974.421574:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782239974.421578:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782239974.421581:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782239974.422503:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 161 00000100:00100000:0.0:1782239974.422516:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc2aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+44:2344:x1868813737990400:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:0.0:1782239974.422586:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc2aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+44:2344:x1868813737990400:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 74us (1907us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239974.422594:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 161 00000100:00100000:0.0:1782239974.422619:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 162 00000100:00100000:0.0:1782239974.422627:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5dee26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f135cc01-3d42-4f2a-80ff-79724f1d3285+5:2344:x1868813737990784:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:0.0:1782239974.422655:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5dee26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f135cc01-3d42-4f2a-80ff-79724f1d3285+5:2344:x1868813737990784:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 30us (1771us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239974.422662:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 162 00000100:00100000:0.0:1782239974.539546:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239974.539800:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737990912 00000100:00100000:2.0:1782239974.539816:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737990912 00000100:00100000:2.0:1782239974.539893:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 156 00000100:00100000:2.0:1782239974.539914:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5dee26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+44:11408:x1868813737990912:12345-192.168.203.32@tcp:101:stat.0 00010000:00010000:2.0:1782239974.539949:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782239974.539979:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fc00/0x8c5345f1c1ec5753 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e6fa expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239974.540087:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29f200/0x8c5345f1c1ec575a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239974.540105:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29f200/0x8c5345f1c1ec575a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239974.540118:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29f200/0x8c5345f1c1ec575a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239974.540136:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e200/0x8c5345f1c1ec5761 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239974.540143:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e200/0x8c5345f1c1ec5761 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239974.540150:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e200/0x8c5345f1c1ec5761 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239974.540857:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e400/0x8c5345f1c1ec5768 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239974.540877:0:5791:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437e00/0x8c5345f1c1ec573e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e6f3 expref: 45 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239974.540887:0:5791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e400/0x8c5345f1c1ec5768 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239974.540930:0:5791:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437e00/0x8c5345f1c1ec573e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e6f3 expref: 45 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239974.540957:0:5791:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437e00/0x8c5345f1c1ec573e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e6f3 expref: 45 pid: 6611 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239974.540975:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5e8ecb480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5791:1868813758966656:192.168.203.32@tcp:104: 00000100:00100000:2.0:1782239974.541577:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c2aa53c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782239974.545119:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5e8ecb480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5791:1868813758966656:192.168.203.32@tcp:104: 00010000:00010000:0.0:1782239974.545165:0:5791:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e400/0x8c5345f1c1ec5768 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782239974.556979:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239974.560241:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737991168 00000100:00100000:3.0:1782239974.560272:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737991168 00000100:00100000:3.0:1782239974.560387:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 43 00000100:00100000:3.0:1782239974.560399:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5dee24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+46:5565:x1868813737991168:12345-192.168.203.32@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1782239974.561479:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5dee24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+47:5565:x1868813737991168:12345-192.168.203.32@tcp:35:ldlm_bl.0 Request processed in 1045us (4477us total) trans 4294967443 rc 0/0 00000100:00100000:3.0:1782239974.561490:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 43 00000100:00100000:2.0:1782239974.578818:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239974.578934:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737991296 00000100:00100000:0.0:1782239974.578958:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737991296 00010000:00010000:0.0:1782239974.579015:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437e00/0x8c5345f1c1ec573e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e6f3 expref: 47 pid: 6611 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782239974.579067:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 64 00000100:00100000:0.0:1782239974.579079:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d021a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+47:2347:x1868813737991296:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782239974.579099:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782239974.579106:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437e00/0x8c5345f1c1ec573e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e6f3 expref: 47 pid: 6611 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239974.579148:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437e00/0x8c5345f1c1ec573e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e6f3 expref: 47 pid: 6611 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239974.579187:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437e00/0x8c5345f1c1ec573e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e6f3 expref: 47 pid: 6611 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239974.579590:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bb5d0df4500) 00010000:00010000:0.0:1782239974.579598:0:5776:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e400/0x8c5345f1c1ec5768 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239974.579610:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e400/0x8c5345f1c1ec5768 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239974.579619:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e400/0x8c5345f1c1ec5768 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239974.579719:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782239974.579911:0:5791:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e400/0x8c5345f1c1ec5768 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239974.579922:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e400/0x8c5345f1c1ec5768 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782239974.579995:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1782239974.580000:0:5791:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782239974.580028:0:5791:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e400/0x8c5345f1c1ec5768 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239974.580065:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e400/0x8c5345f1c1ec5768 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239974.580078:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29f200/0x8c5345f1c1ec575a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239974.580086:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29f200/0x8c5345f1c1ec575a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239974.580093:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29f200/0x8c5345f1c1ec575a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239974.580100:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5ee29f200 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:2.0:1782239974.580104:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29f200/0x8c5345f1c1ec575a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239974.580112:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29f200/0x8c5345f1c1ec575a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239974.580125:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bb5c30e4000) 00010000:00010000:2.0:1782239974.580128:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782239974.580132:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29f200/0x8c5345f1c1ec575a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239974.580138:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29f200/0x8c5345f1c1ec575a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239974.580152:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e200/0x8c5345f1c1ec5761 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239974.580159:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e200/0x8c5345f1c1ec5761 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239974.580172:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e200/0x8c5345f1c1ec5761 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239974.580187:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5ee29e200 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:2.0:1782239974.580190:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e200/0x8c5345f1c1ec5761 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239974.580197:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e200/0x8c5345f1c1ec5761 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239974.580206:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bb5c4ed6400) 00010000:00010000:2.0:1782239974.580208:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1782239974.580292:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d021a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+46:2347:x1868813737991296:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 1212us (1487us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239974.580304:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 64 00010000:00010000:2.0:1782239974.581949:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e200/0x8c5345f1c1ec5761 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239974.581964:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e200/0x8c5345f1c1ec5761 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239974.582041:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fc00/0x8c5345f1c1ec5753 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e6fa expref: 46 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239974.582058:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e400/0x8c5345f1c1ec5768 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e6fa expref: 45 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239974.582069:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bb5d0df4500) 00010000:00010000:2.0:1782239974.582071:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782239974.582075:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5ee29e400, rc 0) 00000100:00100000:2.0:1782239974.582157:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5dee26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+45:11408:x1868813737990912:12345-192.168.203.32@tcp:101:stat.0 Request processed in 42252us (42625us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239974.584252:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 156 00010000:00010000:3.0:1782239974.623057:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782239974.682513:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239974.682689:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737991552 00000100:00100000:3.0:1782239974.682704:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737991552 00000100:00100000:3.0:1782239974.682825:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 157 00000100:00100000:3.0:1782239974.682837:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8eca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+45:11414:x1868813737991552:12345-192.168.203.32@tcp:36:truncate.0 00010000:00010000:3.0:1782239974.682926:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782239974.682973:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e400/0x8c5345f1c1ec5768 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e6fa expref: 45 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239974.683000:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bb5d0df4500) 00010000:00010000:3.0:1782239974.683006:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782239974.684006:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27e00/0x8c5345f1c1ec576f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239974.684035:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27e00/0x8c5345f1c1ec576f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239974.684049:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27e00/0x8c5345f1c1ec576f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782239974.684344:0:5790:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967444 00000004:00010000:3.0:1782239974.684380:0:5790:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000085944543 reply state 000000008607ade1 transno 4294967445 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27e00/0x8c5345f1c1ec576f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239974.684515:0:5790:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782239974.684734:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8eca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+47:11414:x1868813737991552:12345-192.168.203.32@tcp:36:truncate.0 Request processed in 1895us (2231us total) trans 4294967445 rc 0/0 00000100:00100000:3.0:1782239974.684745:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 157 00000020:00080000:3.0:1782239974.684790:0:5790:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1782239974.693571:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27e00/0x8c5345f1c1ec576f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239974.693597:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27e00/0x8c5345f1c1ec576f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239974.693638:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27e00/0x8c5345f1c1ec576f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239974.693645:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f7e27e00 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:1.0:1782239974.693651:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27e00/0x8c5345f1c1ec576f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239974.693660:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27e00/0x8c5345f1c1ec576f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239974.693685:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bb5d0df4500) 00010000:00010000:1.0:1782239974.693689:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782239974.693695:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27e00/0x8c5345f1c1ec576f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239974.693702:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27e00/0x8c5345f1c1ec576f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782239974.696125:0:11535:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1782239974.696145:0:11535:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1782239974.696835:0:11535:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:2.0:1782239974.696844:0:11535:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1782239974.698678:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f48c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813758967168:0@lo:400:kworker.0 00000100:00100000:3.0:1782239974.698830:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239974.699044:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1782239974.699051:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f7811f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3306:1868813758966784:0@lo:400:kworker.0 00000100:00100000:3.0:1782239974.699276:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239974.699943:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f48c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1868813758967296:0@lo:400:kworker.0 00000100:00100000:3.0:1782239974.699992:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239974.700044:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f7812a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1868813758966912:0@lo:400:kworker.0 00000100:00100000:3.0:1782239974.700068:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239974.702038:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f48c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1868813758967424:0@lo:400:kworker.0 00000100:00100000:2.0:1782239974.702614:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758967296 00000100:00100000:2.0:1782239974.702626:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758967296 00000100:00100000:2.0:1782239974.702717:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758966912 00000100:00100000:2.0:1782239974.702721:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758966912 00000100:00100000:2.0:1782239974.702783:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1782239974.702795:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8eeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1868813758967296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782239974.702966:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758966784 00000100:00100000:0.0:1782239974.702972:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758966784 00000100:00100000:0.0:1782239974.703007:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1782239974.703015:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5decbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:3306:x1868813758966784:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1782239974.703166:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782239974.703185:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1782239974.703195:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8eef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1868813758966912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782239974.713917:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8eeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1868813758967296:12345-0@lo:400:kworker.0 Request processed in 11109us (13908us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239974.713946:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1782239974.714581:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f48c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1868813758967296:0@lo:400:kworker.0 00000100:00100000:2.0:1782239974.714644:0:8312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758967168 00000100:00100000:2.0:1782239974.714652:0:8312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758967168 00000100:00100000:2.0:1782239974.714707:0:8312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1782239974.714717:0:8312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8eeca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1868813758967168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782239974.714977:0:8312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8eeca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1868813758967168:12345-0@lo:400:kworker.0 Request processed in 260us (16147us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239974.714984:0:8312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1782239974.715021:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f48c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813758967168:0@lo:400:kworker.0 00000100:00100000:2.0:1782239974.715058:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f7813b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1868813758967040:0@lo:400:kworker.0 00000100:00100000:0.0:1782239974.715328:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5decbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:3306:x1868813758966784:12345-0@lo:400:kworker.0 Request processed in 12312us (16049us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239974.715341:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1782239974.715402:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f7811f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3306:1868813758966784:0@lo:400:kworker.0 00000100:00100000:2.0:1782239974.715654:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239974.717740:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758967040 00000100:00100000:0.0:1782239974.717808:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758967040 00000100:00100000:0.0:1782239974.717932:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1782239974.717952:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8ecad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1868813758967040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782239974.718079:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8ecad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1868813758967040:12345-0@lo:400:kworker.0 Request processed in 127us (2424us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239974.718509:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00080000:2.0:1782239974.719202:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782239974.719279:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f7813b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1868813758967040:0@lo:400:kworker.0 00000100:00100000:1.0:1782239974.722829:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8eef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1868813758966912:12345-0@lo:400:kworker.0 Request processed in 19623us (22745us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239974.722855:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1782239974.723172:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239974.723288:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f7812a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1868813758966912:0@lo:400:kworker.0 00000100:00100000:2.0:1782239974.723527:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758967424 00000100:00100000:2.0:1782239974.723536:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758967424 00000100:00100000:2.0:1782239974.723631:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1782239974.723641:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8eec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3304:x1868813758967424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782239974.723774:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8eec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3304:x1868813758967424:12345-0@lo:400:kworker.0 Request processed in 107us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239974.723781:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1782239974.724020:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f48c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1868813758967424:0@lo:400:kworker.0 00000100:00100000:2.0:1782239974.954037:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239974.954517:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737991680 00000100:00100000:3.0:1782239974.954532:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737991680 00000100:00100000:3.0:1782239974.954671:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 158 00000100:00100000:3.0:1782239974.954685:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8ecb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+46:11428:x1868813737991680:12345-192.168.203.32@tcp:101:stat.0 00010000:00010000:3.0:1782239974.954719:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782239974.954782:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27c00/0x8c5345f1c1ec5776 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e701 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239974.954886:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26600/0x8c5345f1c1ec577d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239974.954906:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26600/0x8c5345f1c1ec577d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239974.954951:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26600/0x8c5345f1c1ec577d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239974.954971:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27400/0x8c5345f1c1ec5784 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239974.954979:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27400/0x8c5345f1c1ec5784 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239974.954986:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27400/0x8c5345f1c1ec5784 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239974.955121:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27000/0x8c5345f1c1ec578b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239974.955129:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27000/0x8c5345f1c1ec578b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239974.955136:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27000/0x8c5345f1c1ec578b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782239974.955184:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:3.0:1782239974.955190:0:5790:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782239974.955235:0:5790:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27000/0x8c5345f1c1ec578b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239974.955258:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27000/0x8c5345f1c1ec578b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239974.955267:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26600/0x8c5345f1c1ec577d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239974.955283:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26600/0x8c5345f1c1ec577d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239974.955291:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26600/0x8c5345f1c1ec577d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239974.955298:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f7e26600 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:3.0:1782239974.955303:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26600/0x8c5345f1c1ec577d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239974.955311:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26600/0x8c5345f1c1ec577d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239974.955328:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bb5c30e4000) 00010000:00010000:3.0:1782239974.955331:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782239974.955339:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26600/0x8c5345f1c1ec577d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239974.955346:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26600/0x8c5345f1c1ec577d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239974.955365:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27400/0x8c5345f1c1ec5784 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239974.955371:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27400/0x8c5345f1c1ec5784 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239974.955377:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27400/0x8c5345f1c1ec5784 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239974.955382:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f7e27400 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:3.0:1782239974.955391:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27400/0x8c5345f1c1ec5784 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239974.955408:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27400/0x8c5345f1c1ec5784 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239974.955416:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bb5d0df4c00) 00010000:00010000:3.0:1782239974.955419:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782239974.955422:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27400/0x8c5345f1c1ec5784 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239974.955428:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27400/0x8c5345f1c1ec5784 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239974.955472:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27c00/0x8c5345f1c1ec5776 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e701 expref: 48 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239974.955487:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27000/0x8c5345f1c1ec578b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e701 expref: 47 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239974.955495:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bb5d0df4500) 00010000:00010000:3.0:1782239974.955497:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782239974.955500:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5f7e27000, rc 0) 00000100:00100000:3.0:1782239974.955592:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8ecb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+47:11428:x1868813737991680:12345-192.168.203.32@tcp:101:stat.0 Request processed in 910us (1571us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239974.955603:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 158 00000100:00100000:0.0:1782239975.118444:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239975.118807:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737991936 00000100:00100000:2.0:1782239975.118822:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737991936 00000100:00100000:2.0:1782239975.118903:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 159 00000100:00100000:2.0:1782239975.118915:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5dee24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+47:11438:x1868813737991936:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:2.0:1782239975.118955:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782239975.118984:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e200/0x8c5345f1c1ec5792 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e708 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782239975.119153:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1782239975.119323:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e200/0x8c5345f1c1ec5792 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e708 expref: 49 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239975.119341:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bb5c55de500) 00010000:00010000:2.0:1782239975.119344:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782239975.119350:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e200/0x8c5345f1c1ec5792 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e708 expref: 49 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239975.119614:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5ee29e200, rc 0) 00000100:00100000:2.0:1782239975.119706:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5dee24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+48:11438:x1868813737991936:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 793us (1281us total) trans 4294967446 rc 301/301 00000100:00100000:2.0:1782239975.119715:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 159 00000100:00100000:2.0:1782239975.129313:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239975.129590:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737992192 00000100:00100000:1.0:1782239975.129604:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737992192 00000100:00100000:1.0:1782239975.129678:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 44 00000100:00100000:1.0:1782239975.129690:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5c779d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+48:11438:x1868813737992192:12345-192.168.203.32@tcp:35:lfs.0 00000100:00100000:1.0:1782239975.130171:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5c779d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+49:11438:x1868813737992192:12345-192.168.203.32@tcp:35:lfs.0 Request processed in 481us (870us total) trans 4294967447 rc 0/0 00000100:00100000:1.0:1782239975.130181:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 44 00000004:00080000:2.0:1782239975.199127:0:7869:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 354271374490ns, next at 355271370520ns, rc = 0 00000100:00100000:0.0:1782239975.199528:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5e8ecbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813758967552:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782239975.199643:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239975.199928:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758967552 00000100:00100000:2.0:1782239975.199947:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758967552 00000100:00100000:2.0:1782239975.200031:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1782239975.200043:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5dee24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1868813758967552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782239975.200106:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782239975.200182:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5dee24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1868813758967552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 140us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239975.200190:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:0.0:1782239975.201820:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782239975.201900:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5e8ecbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813758967552:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782239975.254411:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239975.255672:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737992448 00000100:00100000:0.0:1782239975.255689:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737992448 00000100:00100000:0.0:1782239975.255811:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 160 00000100:00100000:0.0:1782239975.255824:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8eefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+49:11443:x1868813737992448:12345-192.168.203.32@tcp:101:bash.0 00010000:00010000:0.0:1782239975.255858:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782239975.255890:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437c00/0x8c5345f1c1ec57a0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e70f expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239975.256055:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436800/0x8c5345f1c1ec57a7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239975.256076:0:5791:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27000/0x8c5345f1c1ec578b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e701 expref: 50 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239975.256110:0:5791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436800/0x8c5345f1c1ec57a7 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239975.256158:0:5791:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27000/0x8c5345f1c1ec578b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e701 expref: 50 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239975.256174:0:5791:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27000/0x8c5345f1c1ec578b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e701 expref: 50 pid: 5790 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782239975.256192:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5dee27b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5791:1868813758967680:192.168.203.32@tcp:104: 00000100:00100000:0.0:1782239975.262824:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5f7c1ca80 going to sleep for 11 seconds 00000100:00100000:0.0:1782239975.268693:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239975.268791:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737992576 00000100:00100000:3.0:1782239975.268805:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737992576 00010000:00010000:3.0:1782239975.268877:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27000/0x8c5345f1c1ec578b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e701 expref: 51 pid: 5790 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239975.268906:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5dee27b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5791:1868813758967680:192.168.203.32@tcp:104: 00000100:00100000:3.0:1782239975.268959:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 65 00010000:00010000:2.0:1782239975.268960:0:5791:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436800/0x8c5345f1c1ec57a7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239975.268974:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5dee25880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+51:2347:x1868813737992576:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782239975.268995:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782239975.269004:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27000/0x8c5345f1c1ec578b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e701 expref: 51 pid: 5790 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239975.269017:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27000/0x8c5345f1c1ec578b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e701 expref: 51 pid: 5790 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239975.269044:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27000/0x8c5345f1c1ec578b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e701 expref: 51 pid: 5790 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239975.269063:0:5775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bb5d0df4500) 00010000:00010000:3.0:1782239975.269068:0:5775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436800/0x8c5345f1c1ec57a7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239975.269079:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436800/0x8c5345f1c1ec57a7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239975.269088:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436800/0x8c5345f1c1ec57a7 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239975.269117:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782239975.269196:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5dee25880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+50:2347:x1868813737992576:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 225us (522us total) trans 0 rc 0/0 00010000:00010000:2.0:1782239975.269660:0:5791:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436800/0x8c5345f1c1ec57a7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239975.269671:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436800/0x8c5345f1c1ec57a7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782239975.269697:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:2.0:1782239975.269949:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437c00/0x8c5345f1c1ec57a0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e70f expref: 52 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239975.272192:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 65 00010000:00010000:2.0:1782239975.272382:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436800/0x8c5345f1c1ec57a7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e70f expref: 50 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239975.272393:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bb5d0df4500) 00010000:00010000:2.0:1782239975.272396:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1782239975.272400:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5f4436800, rc 0) 00000100:00100000:2.0:1782239975.272503:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8eefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+50:11443:x1868813737992448:12345-192.168.203.32@tcp:101:bash.0 Request processed in 16679us (18107us total) trans 4294967448 rc 0/0 00000100:00100000:2.0:1782239975.272511:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 160 00000100:00100000:0.0:1782239975.285045:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239975.285370:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737992832 00000100:00100000:1.0:1782239975.285384:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737992832 00000100:00100000:1.0:1782239975.285469:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 161 00000100:00100000:1.0:1782239975.285481:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5dee24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+50:11443:x1868813737992832:12345-192.168.203.32@tcp:36:bash.0 00010000:00010000:1.0:1782239975.285920:0:6611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38800/0x8c5345f1c1ec57b5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239975.285964:0:6611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38800/0x8c5345f1c1ec57b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239975.285979:0:6611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38800/0x8c5345f1c1ec57b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782239975.286070:0:6611:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967449 00000004:00010000:1.0:1782239975.286096:0:6611:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000012c3bf reply state 000000000811f81b transno 4294967450 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38800/0x8c5345f1c1ec57b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239975.286107:0:6611:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782239975.286256:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5dee24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+53:11443:x1868813737992832:12345-192.168.203.32@tcp:36:bash.0 Request processed in 775us (1227us total) trans 4294967450 rc 0/0 00000100:00100000:1.0:1782239975.286266:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 161 00000020:00080000:1.0:1782239975.286272:0:6611:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1782239975.289174:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38800/0x8c5345f1c1ec57b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239975.289199:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38800/0x8c5345f1c1ec57b5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239975.289228:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38800/0x8c5345f1c1ec57b5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239975.289235:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f7e38800 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:1.0:1782239975.290395:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38800/0x8c5345f1c1ec57b5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239975.290421:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38800/0x8c5345f1c1ec57b5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239975.290444:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bb5d0df4500) 00010000:00010000:1.0:1782239975.290448:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782239975.290455:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38800/0x8c5345f1c1ec57b5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239975.290462:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38800/0x8c5345f1c1ec57b5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782239975.302213:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239975.303026:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737992960 00000100:00100000:3.0:1782239975.303063:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737992960 00000100:00100000:3.0:1782239975.303147:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 162 00000100:00100000:3.0:1782239975.303159:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5dee26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+52:11443:x1868813737992960:12345-192.168.203.32@tcp:101:bash.0 00010000:00010000:3.0:1782239975.303191:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782239975.303226:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27c00/0x8c5345f1c1ec57bc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e716 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239975.303337:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27000/0x8c5345f1c1ec57c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239975.303355:0:5790:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436800/0x8c5345f1c1ec57a7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e70f expref: 53 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239975.303365:0:5790:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27000/0x8c5345f1c1ec57c3 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239975.303535:0:5790:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436800/0x8c5345f1c1ec57a7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e70f expref: 53 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239975.303552:0:5790:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436800/0x8c5345f1c1ec57a7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e70f expref: 53 pid: 5791 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239975.303569:0:5790:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f780dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5790:1868813758967808:192.168.203.32@tcp:104: 00000100:00100000:3.0:1782239975.303688:0:5790:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5ee3c6240 going to sleep for 11 seconds 00000100:00100000:2.0:1782239975.309172:0:5790:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f780dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5790:1868813758967808:192.168.203.32@tcp:104: 00010000:00010000:2.0:1782239975.309214:0:5790:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27000/0x8c5345f1c1ec57c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239975.320433:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239975.323527:0:7481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737993088 00000100:00100000:2.0:1782239975.323549:0:7481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737993088 00010000:00010000:2.0:1782239975.323632:0:7481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436800/0x8c5345f1c1ec57a7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e70f expref: 54 pid: 5791 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239975.323693:0:7481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 66 00000100:00100000:2.0:1782239975.323705:0:7481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fbf24380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+54:2344:x1868813737993088:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782239975.323732:0:7481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782239975.323741:0:7481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436800/0x8c5345f1c1ec57a7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e70f expref: 54 pid: 5791 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239975.323808:0:7481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436800/0x8c5345f1c1ec57a7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e70f expref: 54 pid: 5791 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239975.323869:0:7481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436800/0x8c5345f1c1ec57a7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e70f expref: 54 pid: 5791 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239975.323891:0:7481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bb5d0df4500) 00010000:00010000:2.0:1782239975.323897:0:7481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27000/0x8c5345f1c1ec57c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239975.323909:0:7481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27000/0x8c5345f1c1ec57c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239975.323918:0:7481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27000/0x8c5345f1c1ec57c3 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239975.323962:0:7481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782239975.324041:0:7481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fbf24380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+53:2344:x1868813737993088:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 337us (3622us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239975.324049:0:7481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 66 00010000:00010000:3.0:1782239975.327573:0:5790:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27000/0x8c5345f1c1ec57c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239975.327595:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27000/0x8c5345f1c1ec57c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782239975.327699:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1782239975.327704:0:5790:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782239975.327731:0:5790:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27000/0x8c5345f1c1ec57c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239975.327808:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27c00/0x8c5345f1c1ec57bc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e716 expref: 53 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239975.327833:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27000/0x8c5345f1c1ec57c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e716 expref: 52 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239975.327844:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bb5d0df4500) 00010000:00010000:3.0:1782239975.327847:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782239975.327850:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5f7e27000, rc 0) 00000100:00100000:3.0:1782239975.327951:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5dee26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+52:11443:x1868813737992960:12345-192.168.203.32@tcp:101:bash.0 Request processed in 24793us (25751us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239975.327960:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 162 00000100:00100000:3.0:1782239975.337100:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239975.337703:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737993344 00000100:00100000:1.0:1782239975.337718:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737993344 00000100:00100000:1.0:1782239975.337827:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 45 00000100:00100000:1.0:1782239975.337841:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f780d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+52:11443:x1868813737993344:12345-192.168.203.32@tcp:35:bash.0 00000100:00100000:1.0:1782239975.338563:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f780d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+53:11443:x1868813737993344:12345-192.168.203.32@tcp:35:bash.0 Request processed in 720us (1474us total) trans 4294967451 rc 0/0 00000100:00100000:1.0:1782239975.338574:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 45 00000100:00100000:1.0:1782239975.483252:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239975.483429:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737993600 00000100:00100000:0.0:1782239975.483442:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737993600 00000100:00100000:0.0:1782239975.483524:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 163 00000100:00100000:0.0:1782239975.483536:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fbf24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+53:11454:x1868813737993600:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:0.0:1782239975.483581:0:6611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782239975.483607:0:6611:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436400/0x8c5345f1c1ec57ca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e71d expref: -99 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782239975.483829:0:6611:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1782239975.484011:0:6611:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436400/0x8c5345f1c1ec57ca lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e71d expref: 55 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239975.484053:0:6611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bb5c55de500) 00010000:00010000:0.0:1782239975.484056:0:6611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782239975.484063:0:6611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436400/0x8c5345f1c1ec57ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e71d expref: 55 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239975.484080:0:6611:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5f4436400, rc 0) 00000100:00100000:0.0:1782239975.484163:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fbf24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+54:11454:x1868813737993600:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 628us (923us total) trans 4294967452 rc 301/301 00000100:00100000:0.0:1782239975.484172:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 163 00000100:00100000:2.0:1782239975.490847:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239975.490976:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737993728 00000100:00100000:0.0:1782239975.490989:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737993728 00000100:00100000:0.0:1782239975.491063:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 164 00000100:00100000:0.0:1782239975.491076:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8ecbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+54:11454:x1868813737993728:12345-192.168.203.32@tcp:34:lfs.0 00010000:00010000:0.0:1782239975.491185:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436400/0x8c5345f1c1ec57d8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239975.491217:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436400/0x8c5345f1c1ec57d8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239975.491232:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436400/0x8c5345f1c1ec57d8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239975.491251:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436e00/0x8c5345f1c1ec57df lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239975.491259:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436e00/0x8c5345f1c1ec57df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239975.491289:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436e00/0x8c5345f1c1ec57df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239975.491440:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436a00/0x8c5345f1c1ec57e6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239975.491451:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436a00/0x8c5345f1c1ec57e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239975.491458:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436a00/0x8c5345f1c1ec57e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782239975.491516:0:5791:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436a00/0x8c5345f1c1ec57e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239975.491531:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436400/0x8c5345f1c1ec57d8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239975.491537:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436400/0x8c5345f1c1ec57d8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239975.491544:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436400/0x8c5345f1c1ec57d8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239975.491551:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f4436400 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:0.0:1782239975.491556:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436400/0x8c5345f1c1ec57d8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239975.491565:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436400/0x8c5345f1c1ec57d8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239975.491578:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bb5c30e4000) 00010000:00010000:0.0:1782239975.491587:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782239975.491594:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436400/0x8c5345f1c1ec57d8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239975.491600:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436400/0x8c5345f1c1ec57d8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239975.491617:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436e00/0x8c5345f1c1ec57df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239975.491622:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436e00/0x8c5345f1c1ec57df lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239975.491628:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436e00/0x8c5345f1c1ec57df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239975.491633:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f4436e00 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:0.0:1782239975.491635:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436e00/0x8c5345f1c1ec57df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239975.491642:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436e00/0x8c5345f1c1ec57df lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239975.491649:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bb5c55de100) 00010000:00010000:0.0:1782239975.491652:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782239975.491655:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436e00/0x8c5345f1c1ec57df lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239975.491660:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436e00/0x8c5345f1c1ec57df lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239975.491676:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436a00/0x8c5345f1c1ec57e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239975.491688:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436a00/0x8c5345f1c1ec57e6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239975.491693:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436a00/0x8c5345f1c1ec57e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239975.491698:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f4436a00 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:0.0:1782239975.491702:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436a00/0x8c5345f1c1ec57e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239975.491708:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436a00/0x8c5345f1c1ec57e6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239975.491716:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bb5d0df4500) 00010000:00010000:0.0:1782239975.491718:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782239975.491721:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436a00/0x8c5345f1c1ec57e6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239975.491727:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436a00/0x8c5345f1c1ec57e6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782239975.491884:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8ecbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+54:11454:x1868813737993728:12345-192.168.203.32@tcp:34:lfs.0 Request processed in 810us (1053us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239975.491894:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 164 00000100:00100000:3.0:1782239975.495943:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239975.496601:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737993984 00000100:00100000:1.0:1782239975.496635:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737993984 00000100:00100000:1.0:1782239975.496709:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 46 00000100:00100000:1.0:1782239975.496723:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f780d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+54:11454:x1868813737993984:12345-192.168.203.32@tcp:35:lfs.0 00000100:00100000:1.0:1782239975.497258:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f780d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+55:11454:x1868813737993984:12345-192.168.203.32@tcp:35:lfs.0 Request processed in 535us (1334us total) trans 4294967453 rc 0/0 00000100:00100000:1.0:1782239975.497267:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 46 00000100:00100000:2.0:1782239975.565036:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239975.565340:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737994240 00000100:00100000:0.0:1782239975.565354:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737994240 00000100:00100000:0.0:1782239975.565431:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 165 00000100:00100000:0.0:1782239975.565443:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+55:11457:x1868813737994240:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:0.0:1782239975.565474:0:6611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782239975.565561:0:6611:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436a00/0x8c5345f1c1ec57ed lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e724 expref: -99 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239975.565667:0:6611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436e00/0x8c5345f1c1ec57f4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239975.565687:0:6611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436e00/0x8c5345f1c1ec57f4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239975.565703:0:6611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436e00/0x8c5345f1c1ec57f4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239975.565720:0:6611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436400/0x8c5345f1c1ec57fb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239975.565727:0:6611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436400/0x8c5345f1c1ec57fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239975.565733:0:6611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436400/0x8c5345f1c1ec57fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239975.566150:0:6611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437a00/0x8c5345f1c1ec5802 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239975.566161:0:6611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437a00/0x8c5345f1c1ec5802 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239975.566169:0:6611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437a00/0x8c5345f1c1ec5802 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782239975.566182:0:6611:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1782239975.566340:0:6611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436e00/0x8c5345f1c1ec57f4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239975.566365:0:6611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436e00/0x8c5345f1c1ec57f4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239975.566373:0:6611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436e00/0x8c5345f1c1ec57f4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239975.566381:0:6611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f4436e00 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:0.0:1782239975.566388:0:6611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436e00/0x8c5345f1c1ec57f4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239975.566398:0:6611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436e00/0x8c5345f1c1ec57f4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239975.566414:0:6611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bb5c30e4000) 00010000:00010000:0.0:1782239975.566418:0:6611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782239975.566424:0:6611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436e00/0x8c5345f1c1ec57f4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239975.566430:0:6611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436e00/0x8c5345f1c1ec57f4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239975.566449:0:6611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436400/0x8c5345f1c1ec57fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239975.566455:0:6611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436400/0x8c5345f1c1ec57fb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239975.566462:0:6611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436400/0x8c5345f1c1ec57fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239975.566468:0:6611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f4436400 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:0.0:1782239975.566478:0:6611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436400/0x8c5345f1c1ec57fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239975.566486:0:6611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436400/0x8c5345f1c1ec57fb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239975.567354:0:6611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bb5c55de100) 00010000:00010000:0.0:1782239975.567359:0:6611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782239975.567363:0:6611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436400/0x8c5345f1c1ec57fb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239975.567372:0:6611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436400/0x8c5345f1c1ec57fb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239975.567452:0:6611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436a00/0x8c5345f1c1ec57ed lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e724 expref: 58 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239975.567469:0:6611:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437a00/0x8c5345f1c1ec5802 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e724 expref: 57 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239975.567477:0:6611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bb5d0df4500) 00010000:00010000:0.0:1782239975.567479:0:6611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782239975.567482:0:6611:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5f4437a00, rc 0) 00000100:00100000:0.0:1782239975.567691:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+57:11457:x1868813737994240:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 2249us (2668us total) trans 4294967454 rc 0/0 00000100:00100000:0.0:1782239975.567702:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 165 00000100:00100000:2.0:1782239975.572557:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239975.572680:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737994368 00000100:00100000:0.0:1782239975.572695:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737994368 00000100:00100000:0.0:1782239975.572786:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 166 00000100:00100000:0.0:1782239975.572800:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+57:11457:x1868813737994368:12345-192.168.203.32@tcp:54:lfs.0 00010000:00010000:0.0:1782239975.572998:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437600/0x8c5345f1c1ec5810 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239975.573020:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437600/0x8c5345f1c1ec5810 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239975.573033:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437600/0x8c5345f1c1ec5810 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239975.573069:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437600/0x8c5345f1c1ec5810 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239975.573077:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437600/0x8c5345f1c1ec5810 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239975.573084:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437600/0x8c5345f1c1ec5810 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239975.573091:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f4437600 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:0.0:1782239975.573095:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437600/0x8c5345f1c1ec5810 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239975.573104:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437600/0x8c5345f1c1ec5810 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239975.573117:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bb5d0df4500) 00010000:00010000:0.0:1782239975.573120:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782239975.573126:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437600/0x8c5345f1c1ec5810 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239975.573133:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437600/0x8c5345f1c1ec5810 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782239975.573461:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+57:11457:x1868813737994368:12345-192.168.203.32@tcp:54:lfs.0 Request processed in 662us (916us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239975.573471:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 166 00000100:00100000:3.0:1782239975.577095:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239975.577941:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737994496 00000100:00100000:0.0:1782239975.577955:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737994496 00000100:00100000:0.0:1782239975.578043:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 12 00000100:00100000:0.0:1782239975.578055:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f780ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+57:2347:x1868813737994496:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782239975.578075:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782239975.578109:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437a00/0x8c5345f1c1ec5802 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e724 expref: 57 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239975.578133:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bb5d0df4500) 00010000:00010000:0.0:1782239975.578139:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782239975.578449:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f780ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+56:2347:x1868813737994496:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 394us (1367us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239975.578459:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 12 00000100:00100000:2.0:1782239975.582140:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239975.582311:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737994752 00000100:00100000:1.0:1782239975.582326:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737994752 00000100:00100000:1.0:1782239975.582399:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 47 00000100:00100000:1.0:1782239975.582412:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+56:11457:x1868813737994752:12345-192.168.203.32@tcp:35:lfs.0 00000100:00100000:1.0:1782239975.582735:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+57:11457:x1868813737994752:12345-192.168.203.32@tcp:35:lfs.0 Request processed in 324us (610us total) trans 4294967455 rc 0/0 00000100:00100000:1.0:1782239975.582743:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 47 00010000:00010000:3.0:1782239975.648030:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782239975.816908:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239975.817167:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737995008 00000100:00100000:0.0:1782239975.817181:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737995008 00000100:00100000:0.0:1782239975.817263:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 167 00000100:00100000:0.0:1782239975.817275:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f77f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+57:11475:x1868813737995008:12345-192.168.203.32@tcp:101:cat.0 00010000:00010000:0.0:1782239975.817309:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782239975.817335:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437a00/0x8c5345f1c1ec5817 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e72b expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239975.817669:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437600/0x8c5345f1c1ec581e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239975.817708:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437600/0x8c5345f1c1ec581e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239975.817723:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437600/0x8c5345f1c1ec581e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782239975.817739:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1782239975.822055:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437a00/0x8c5345f1c1ec5817 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e72b expref: 60 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239975.822098:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437600/0x8c5345f1c1ec581e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e72b expref: 59 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239975.822110:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bb5d0df4500) 00010000:00010000:0.0:1782239975.822113:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1782239975.822118:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5f4437600, rc 0) 00000100:00100000:0.0:1782239975.822398:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f77f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+59:11475:x1868813737995008:12345-192.168.203.32@tcp:101:cat.0 Request processed in 5122us (5511us total) trans 4294967456 rc 0/0 00000100:00100000:0.0:1782239975.822409:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 167 00000100:00100000:2.0:1782239975.858658:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239975.858973:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737995136 00000100:00100000:3.0:1782239975.858988:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737995136 00000100:00100000:3.0:1782239975.859064:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 168 00000100:00100000:3.0:1782239975.859076:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f77f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+59:11476:x1868813737995136:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:3.0:1782239975.859109:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782239975.859147:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27c00/0x8c5345f1c1ec582c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e732 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239975.859451:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27400/0x8c5345f1c1ec5833 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239975.859469:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27400/0x8c5345f1c1ec5833 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239975.859494:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27400/0x8c5345f1c1ec5833 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782239975.859582:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:3.0:1782239975.859587:0:5790:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1782239975.859618:0:5790:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27400/0x8c5345f1c1ec5833 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239975.859653:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27c00/0x8c5345f1c1ec582c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e732 expref: 61 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239975.859678:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27400/0x8c5345f1c1ec5833 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e732 expref: 60 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239975.859687:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bb5c30e4000) 00010000:00010000:3.0:1782239975.859691:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782239975.859695:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5f7e27400, rc 0) 00000100:00100000:3.0:1782239975.859856:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f77f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+60:11476:x1868813737995136:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 782us (1215us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239975.859865:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 168 00000100:00100000:2.0:1782239975.867045:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239975.867168:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737995520 00000100:00100000:1.0:1782239975.867182:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737995520 00000100:00100000:1.0:1782239975.867467:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 48 00000100:00100000:1.0:1782239975.867482:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f77f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+60:11476:x1868813737995520:12345-192.168.203.32@tcp:35:lfs.0 00000100:00100000:1.0:1782239975.868169:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f77f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+61:11476:x1868813737995520:12345-192.168.203.32@tcp:35:lfs.0 Request processed in 684us (1132us total) trans 4294967457 rc 0/0 00000100:00100000:1.0:1782239975.868180:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 48 00000100:00100000:2.0:1782239975.870965:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239975.871153:0:7481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737995648 00000100:00100000:3.0:1782239975.871166:0:7481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737995648 00000100:00100000:3.0:1782239975.871415:0:7481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 13 00000100:00100000:3.0:1782239975.871428:0:7481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f77f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+61:11476:x1868813737995648:12345-192.168.203.32@tcp:103:lfs.0 00010000:00010000:3.0:1782239975.871449:0:7481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1782239975.871481:0:7481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27000/0x8c5345f1c1ec57c3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e716 expref: 61 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239975.871510:0:7481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437600/0x8c5345f1c1ec581e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e72b expref: 60 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239975.871522:0:7481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26000/0x8c5345f1c1ec56ce lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e6d7 expref: 59 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239975.871533:0:7481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bb5d0df4500) 00010000:00010000:3.0:1782239975.871546:0:7481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782239975.871618:0:7481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f77f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+58:11476:x1868813737995648:12345-192.168.203.32@tcp:103:lfs.0 Request processed in 192us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239975.871626:0:7481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 13 00000100:00100000:2.0:1782239975.881514:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239975.881627:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737995776 00000100:00100000:1.0:1782239975.881641:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737995776 00000100:00100000:1.0:1782239975.881729:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 169 00000100:00100000:1.0:1782239975.881743:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f77f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+58:11476:x1868813737995776:12345-192.168.203.32@tcp:58:lfs.0 00010000:00010000:1.0:1782239975.881950:0:6611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39e00/0x8c5345f1c1ec583a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239975.881980:0:6611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39e00/0x8c5345f1c1ec583a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239975.881995:0:6611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39e00/0x8c5345f1c1ec583a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782239975.882266:0:6611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:1.0:1782239975.882391:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f77f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+58:11476:x1868813737995776:12345-192.168.203.32@tcp:58:lfs.0 Request processed in 650us (893us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239975.882401:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 169 00000100:00100000:2.0:1782239975.949687:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239975.953558:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737995904 00000100:00100000:0.0:1782239975.953582:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737995904 00000100:00100000:0.0:1782239975.953690:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 170 00000100:00100000:0.0:1782239975.953704:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f77f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+58:11478:x1868813737995904:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:0.0:1782239975.953736:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782239975.953802:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437a00/0x8c5345f1c1ec5841 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e739 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239975.953925:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436a00/0x8c5345f1c1ec5848 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239975.953952:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436a00/0x8c5345f1c1ec5848 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239975.953969:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436a00/0x8c5345f1c1ec5848 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239975.953987:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436400/0x8c5345f1c1ec584f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239975.953996:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436400/0x8c5345f1c1ec584f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239975.954003:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436400/0x8c5345f1c1ec584f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239975.954139:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436e00/0x8c5345f1c1ec5856 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239975.954148:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436e00/0x8c5345f1c1ec5856 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239975.954155:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436e00/0x8c5345f1c1ec5856 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782239975.954202:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1782239975.954207:0:5791:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782239975.954230:0:5791:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436e00/0x8c5345f1c1ec5856 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239975.954255:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436e00/0x8c5345f1c1ec5856 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239975.954265:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436a00/0x8c5345f1c1ec5848 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239975.954271:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436a00/0x8c5345f1c1ec5848 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239975.954278:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436a00/0x8c5345f1c1ec5848 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239975.954284:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f4436a00 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:0.0:1782239975.954289:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436a00/0x8c5345f1c1ec5848 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239975.954297:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436a00/0x8c5345f1c1ec5848 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239975.954311:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bb5c30e4000) 00010000:00010000:0.0:1782239975.954314:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782239975.954320:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436a00/0x8c5345f1c1ec5848 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239975.954327:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436a00/0x8c5345f1c1ec5848 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239975.954343:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436400/0x8c5345f1c1ec584f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239975.954350:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436400/0x8c5345f1c1ec584f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239975.954362:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436400/0x8c5345f1c1ec584f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239975.954368:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f4436400 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:0.0:1782239975.954371:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436400/0x8c5345f1c1ec584f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239975.954377:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436400/0x8c5345f1c1ec584f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239975.954399:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bb5c55de100) 00010000:00010000:0.0:1782239975.954402:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782239975.954406:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436400/0x8c5345f1c1ec584f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239975.954412:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436400/0x8c5345f1c1ec584f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239975.954451:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437a00/0x8c5345f1c1ec5841 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e739 expref: 60 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239975.954467:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436e00/0x8c5345f1c1ec5856 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e739 expref: 59 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239975.954474:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bb5c30e4900) 00010000:00010000:0.0:1782239975.954476:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782239975.954479:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5f4436e00, rc 0) 00000100:00100000:0.0:1782239975.954576:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f77f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+59:11478:x1868813737995904:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 873us (4902us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239975.954593:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 170 00000001:00080000:2.0:1782239976.365652:0:7493:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:2.0:1782239976.365707:0:7493:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00010000:00010000:3.0:1782239976.672010:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1782239976.736706:0:11535:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782239976.736720:0:11535:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1782239976.736795:0:11535:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1782239976.736807:0:11535:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1782239976.736979:0:11535:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f780f800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11535:1868813758967936:192.168.203.32@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1782239976.741878:0:11535:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5ee3c6cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1782239976.746404:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239976.746488:0:11535:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f780f800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11535:1868813758967936:192.168.203.32@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1782239976.748939:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737996032 00000100:00100000:2.0:1782239976.748960:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737996032 00000100:00100000:2.0:1782239976.749042:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 171 00000100:00100000:2.0:1782239976.749054:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f780dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+59:11489:x1868813737996032:12345-192.168.203.32@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1782239976.749096:0:6611:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1782239976.749435:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f780dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+59:11489:x1868813737996032:12345-192.168.203.32@tcp:53:lhsmtool_posix.0 Request processed in 382us (3045us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239976.749444:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 171 00000100:00080000:2.0:1782239976.749472:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782239976.755945:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239976.764682:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737996160 00000100:00100000:1.0:1782239976.764700:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737996160 00000100:00100000:1.0:1782239976.764792:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 172 00000100:00100000:1.0:1782239976.764805:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5dee25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+59:11489:x1868813737996160:12345-192.168.203.32@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1782239976.764898:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38000/0x8c5345f1c1ec585d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239976.764918:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38000/0x8c5345f1c1ec585d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239976.764944:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38000/0x8c5345f1c1ec585d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239976.764960:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39600/0x8c5345f1c1ec5864 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239976.764968:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39600/0x8c5345f1c1ec5864 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239976.764975:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39600/0x8c5345f1c1ec5864 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239976.765016:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38e00/0x8c5345f1c1ec586b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239976.765024:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38e00/0x8c5345f1c1ec586b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239976.765030:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38e00/0x8c5345f1c1ec586b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782239976.765208:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1782239976.765214:0:5790:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782239976.765231:0:5790:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38e00/0x8c5345f1c1ec586b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239976.765245:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38000/0x8c5345f1c1ec585d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239976.765253:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38000/0x8c5345f1c1ec585d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239976.765261:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38000/0x8c5345f1c1ec585d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239976.765268:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f7e38000 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:1.0:1782239976.765273:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38000/0x8c5345f1c1ec585d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239976.765281:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38000/0x8c5345f1c1ec585d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239976.765297:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bb5d0df4b00) 00010000:00010000:1.0:1782239976.765307:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782239976.765313:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38000/0x8c5345f1c1ec585d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239976.765320:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38000/0x8c5345f1c1ec585d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239976.765334:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39600/0x8c5345f1c1ec5864 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239976.765341:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39600/0x8c5345f1c1ec5864 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239976.765347:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39600/0x8c5345f1c1ec5864 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239976.765353:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f7e39600 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:1.0:1782239976.765356:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39600/0x8c5345f1c1ec5864 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239976.765363:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39600/0x8c5345f1c1ec5864 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239976.765370:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff9bb5c30e4e00) 00010000:00010000:1.0:1782239976.765373:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782239976.765376:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39600/0x8c5345f1c1ec5864 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239976.765381:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39600/0x8c5345f1c1ec5864 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239976.765398:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38e00/0x8c5345f1c1ec586b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239976.765410:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38e00/0x8c5345f1c1ec586b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239976.765416:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38e00/0x8c5345f1c1ec586b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239976.765421:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f7e38e00 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:1.0:1782239976.765424:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38e00/0x8c5345f1c1ec586b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239976.765431:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38e00/0x8c5345f1c1ec586b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239976.765440:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bb5c30e4900) 00010000:00010000:1.0:1782239976.765442:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782239976.765446:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38e00/0x8c5345f1c1ec586b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239976.765452:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38e00/0x8c5345f1c1ec586b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239976.765830:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5dee25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+59:11489:x1868813737996160:12345-192.168.203.32@tcp:34:lhsmtool_posix.0 Request processed in 1022us (9904us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239976.765841:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 172 00000100:00100000:3.0:1782239976.775984:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239976.776862:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737996416 00000100:00100000:0.0:1782239976.776880:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737996416 00000100:00100000:0.0:1782239976.776971:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 173 00000100:00100000:0.0:1782239976.776984:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f780f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+59:11489:x1868813737996416:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782239976.777016:0:6611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782239976.777044:0:6611:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436400/0x8c5345f1c1ec5872 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e740 expref: -99 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239976.778897:0:6611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436a00/0x8c5345f1c1ec5879 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239976.778937:0:6611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436a00/0x8c5345f1c1ec5879 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239976.778952:0:6611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436a00/0x8c5345f1c1ec5879 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782239976.778965:0:6611:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1782239976.780168:0:6611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436a00/0x8c5345f1c1ec5879 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239976.780183:0:6611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436a00/0x8c5345f1c1ec5879 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239976.780191:0:6611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436a00/0x8c5345f1c1ec5879 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239976.780208:0:6611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f4436a00 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:0.0:1782239976.780220:0:6611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436a00/0x8c5345f1c1ec5879 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239976.780229:0:6611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436a00/0x8c5345f1c1ec5879 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239976.780249:0:6611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bb5c30e4900) 00010000:00010000:0.0:1782239976.780252:0:6611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782239976.780257:0:6611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436a00/0x8c5345f1c1ec5879 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239976.780264:0:6611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436a00/0x8c5345f1c1ec5879 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239976.780331:0:6611:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436400/0x8c5345f1c1ec5872 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e740 expref: 61 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239976.780344:0:6611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bb5d0df4b00) 00010000:00010000:0.0:1782239976.780347:0:6611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782239976.780351:0:6611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436400/0x8c5345f1c1ec5872 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e740 expref: 61 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239976.780361:0:6611:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5f4436400, rc 0) 00000100:00100000:0.0:1782239976.780464:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f780f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+60:11489:x1868813737996416:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 3481us (4492us total) trans 4294967458 rc 301/301 00000100:00100000:0.0:1782239976.780475:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 173 00000100:00100000:1.0:1782239976.789140:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239976.789203:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737996544 00000100:00100000:1.0:1782239976.789216:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737996544 00000100:00100000:1.0:1782239976.789297:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 174 00000100:00100000:1.0:1782239976.789308:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fbf25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+60:11489:x1868813737996544:12345-192.168.203.32@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1782239976.789367:0:5790:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1782239976.789520:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fbf25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+60:11489:x1868813737996544:12345-192.168.203.32@tcp:53:lhsmtool_posix.0 Request processed in 213us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239976.789836:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 174 00000100:00100000:1.0:1782239976.798280:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239976.798330:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737996800 00000100:00100000:0.0:1782239976.798346:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737996800 00000100:00100000:0.0:1782239976.798421:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 175 00000100:00100000:0.0:1782239976.798433:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5eddf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+60:11489:x1868813737996800:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782239976.798474:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782239976.798478:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1782239976.798515:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27400/0x8c5345f1c1ec5833 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e732 expref: 60 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239976.798549:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bb5c30e4000) 00010000:00010000:0.0:1782239976.798555:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782239976.798572:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437600/0x8c5345f1c1ec5887 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e747 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782239976.799531:0:5792:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:0.0:1782239976.799888:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436400/0x8c5345f1c1ec588e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239976.799907:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436400/0x8c5345f1c1ec588e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239976.799930:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436400/0x8c5345f1c1ec588e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239976.800002:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437600/0x8c5345f1c1ec5887 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e747 expref: 62 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239976.800022:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436400/0x8c5345f1c1ec588e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e747 expref: 61 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239976.800032:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9bb5c55de100) 00010000:00010000:0.0:1782239976.800035:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782239976.800045:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5f4436400, rc 0) 00000100:00100000:0.0:1782239976.800146:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5eddf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+61:11489:x1868813737996800:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 1713us (1879us total) trans 4294967459 rc 0/0 00000100:00100000:0.0:1782239976.800156:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 175 00000100:00100000:3.0:1782239976.821220:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239976.821287:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737997056 00000100:00100000:3.0:1782239976.821300:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737997056 00000100:00100000:3.0:1782239976.821371:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 176 00000100:00100000:3.0:1782239976.821391:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7e0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+61:11489:x1868813737997056:12345-192.168.203.32@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1782239976.821480:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782239976.821517:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436400/0x8c5345f1c1ec588e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e747 expref: 61 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239976.821536:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9bb5c55de100) 00010000:00010000:3.0:1782239976.821549:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782239976.821576:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27c00/0x8c5345f1c1ec589c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239976.821593:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27c00/0x8c5345f1c1ec589c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239976.821604:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27c00/0x8c5345f1c1ec589c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239976.821620:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26000/0x8c5345f1c1ec58a3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x74eb191 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239976.821627:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26000/0x8c5345f1c1ec58a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x74eb191 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239976.821634:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26000/0x8c5345f1c1ec58a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x74eb191 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239976.822014:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27c00/0x8c5345f1c1ec589c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239976.822031:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27c00/0x8c5345f1c1ec589c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239976.822038:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27c00/0x8c5345f1c1ec589c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239976.822044:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f7e27c00 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:3.0:1782239976.822050:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27c00/0x8c5345f1c1ec589c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239976.822057:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27c00/0x8c5345f1c1ec589c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239976.822067:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bb5c30e4000) 00010000:00010000:3.0:1782239976.822070:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782239976.822074:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27c00/0x8c5345f1c1ec589c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239976.822081:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27c00/0x8c5345f1c1ec589c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239976.822092:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26000/0x8c5345f1c1ec58a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x74eb191 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239976.822097:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26000/0x8c5345f1c1ec58a3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x74eb191 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239976.822102:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26000/0x8c5345f1c1ec58a3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x74eb191 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239976.822107:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f7e26000 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:3.0:1782239976.822115:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26000/0x8c5345f1c1ec58a3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x74eb191 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239976.822121:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26000/0x8c5345f1c1ec58a3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x74eb191 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239976.822129:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x74eb191 (ffff9bb5d0df4c00) 00010000:00010000:3.0:1782239976.822131:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782239976.822134:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26000/0x8c5345f1c1ec58a3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x74eb191 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239976.822140:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26000/0x8c5345f1c1ec58a3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x74eb191 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239976.822245:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7e0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+60:11489:x1868813737997056:12345-192.168.203.32@tcp:36:lhsmtool_posix.0 Request processed in 862us (1035us total) trans 0 rc -2/-2 00000100:00100000:3.0:1782239976.822253:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 176 00000100:00100000:2.0:1782239976.830395:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239976.837635:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737997184 00000100:00100000:1.0:1782239976.837656:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737997184 00000100:00100000:1.0:1782239976.837735:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 177 00000100:00100000:1.0:1782239976.837777:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f77f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+60:11489:x1868813737997184:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782239976.837808:0:6611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782239976.837839:0:6611:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38000/0x8c5345f1c1ec58aa lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e74e expref: -99 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239976.837886:0:6611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38c00/0x8c5345f1c1ec58b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239976.837905:0:6611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38c00/0x8c5345f1c1ec58b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239976.837918:0:6611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38c00/0x8c5345f1c1ec58b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239976.838066:0:6611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38000/0x8c5345f1c1ec58aa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e74e expref: 62 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239976.838097:0:6611:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38c00/0x8c5345f1c1ec58b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e74e expref: 61 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239976.838121:0:6611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9bb5c30e4e00) 00010000:00010000:1.0:1782239976.838125:0:6611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1782239976.838130:0:6611:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5f7e38c00, rc 0) 00000100:00100000:1.0:1782239976.838216:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f77f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+61:11489:x1868813737997184:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 471us (7836us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239976.838224:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 177 00000100:00100000:3.0:1782239976.875463:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239976.875508:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737997440 00000100:00100000:3.0:1782239976.875522:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737997440 00000100:00100000:3.0:1782239976.875607:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 178 00000100:00100000:3.0:1782239976.875620:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fff00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+61:11489:x1868813737997440:12345-192.168.203.32@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1782239976.875738:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27000/0x8c5345f1c1ec58b8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239976.875795:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27000/0x8c5345f1c1ec58b8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239976.875809:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27000/0x8c5345f1c1ec58b8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782239976.876270:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:3.0:1782239976.876284:0:5790:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 355948534968ns, next at 356948531934ns, rc = 0 00000004:00010000:3.0:1782239976.876393:0:5790:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008cabcf5c reply state 0000000017e5c5bc transno 4294967460 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27000/0x8c5345f1c1ec58b8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239976.876404:0:5790:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782239976.876545:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fff00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+63:11489:x1868813737997440:12345-192.168.203.32@tcp:36:lhsmtool_posix.0 Request processed in 925us (1094us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1782239976.876554:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 178 00010000:00010000:0.0:1782239976.883299:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27000/0x8c5345f1c1ec58b8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239976.883323:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27000/0x8c5345f1c1ec58b8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239976.883333:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27000/0x8c5345f1c1ec58b8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239976.883340:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f7e27000 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:0.0:1782239976.883357:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27000/0x8c5345f1c1ec58b8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239976.883367:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27000/0x8c5345f1c1ec58b8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239976.883389:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9bb5c30e4e00) 00010000:00010000:0.0:1782239976.883392:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1782239976.883399:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27000/0x8c5345f1c1ec58b8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239976.883405:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27000/0x8c5345f1c1ec58b8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239976.886526:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239976.886594:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737997568 00000100:00100000:1.0:1782239976.886608:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737997568 00000100:00100000:1.0:1782239976.886680:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 179 00000100:00100000:1.0:1782239976.886691:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5eddf5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+62:11489:x1868813737997568:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782239976.886724:0:6611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782239976.886768:0:6611:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38000/0x8c5345f1c1ec58bf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e755 expref: -99 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239976.886842:0:6611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38000/0x8c5345f1c1ec58bf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e755 expref: 63 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239976.886859:0:6611:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38000/0x8c5345f1c1ec58bf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e755 expref: 63 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239976.886881:0:6611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9bb5c30e4e00) 00010000:00010000:1.0:1782239976.886883:0:6611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782239976.886888:0:6611:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5f7e38000, rc 0) 00000100:00100000:1.0:1782239976.886974:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5eddf5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+63:11489:x1868813737997568:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 284us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239976.886996:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 179 00000001:00080000:1.0:1782239976.892271:0:5812:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967456 is committed 00000001:00080000:1.0:1782239976.892414:0:5812:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967457 is committed 00000004:00080000:1.0:1782239976.892445:0:5812:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:1.0:1782239976.892465:0:5812:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bb5c8460780 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:1.0:1782239976.892471:0:5812:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9bb5c9b29a00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bb5c8460840 00000020:00080000:1.0:1782239976.892474:0:5812:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9bb5c9b29f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bb5e8edb000 00000004:00080000:1.0:1782239976.892510:0:5812:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000100:00100000:1.0:1782239976.892949:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5eddf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813758968064:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1782239976.893048:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1782239976.893208:0:5823:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000100:00100000:3.0:1782239976.893509:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000020:00080000:0.0:1782239976.893593:0:5823:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1782239976.894307:0:8312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758968064 00000100:00100000:2.0:1782239976.894319:0:8312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758968064 00000100:00100000:2.0:1782239976.894379:0:8312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737997696 00000100:00100000:2.0:1782239976.894383:0:8312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737997696 00000100:00100000:2.0:1782239976.894419:0:8312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1782239976.894430:0:8312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5eddf5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1868813758968064:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1782239976.894465:0:8312:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:2.0:1782239976.894515:0:8312:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a3ad2e5, atime: 0x6a3ad2e5, ctime: 0x6a3ad2e5, blocks: 0xb 00010000:00010000:2.0:1782239976.894524:0:8312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9cd392c/0x8c5345f1c1ec58c6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239976.894543:0:8312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=355s v=(0 0) 00010000:00010000:2.0:1782239976.894548:0:8312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782239976.894555:0:8312:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a9cd392c/0x8c5345f1c1ec58c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239976.894573:0:8312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a9cd392c/0x8c5345f1c1ec58c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239976.894600:0:8312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9cd392c/0x8c5345f1c1ec58c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239976.894608:0:8312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a9cd392c/0x8c5345f1c1ec58c6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239976.894627:0:8312:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1782239976.895646:0:8312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5eddf5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3306:x1868813758968064:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1212us (2593us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1782239976.895657:0:8312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1782239976.895690:0:8312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 51 00000100:00100000:2.0:1782239976.895701:0:8312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ee2ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+6:2344:x1868813737997696:12345-192.168.203.32@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1782239976.896011:0:8312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ee2ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+7:2344:x1868813737997696:12345-192.168.203.32@tcp:2:lhsmtool_posix.0 Request processed in 311us (2504us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1782239976.896019:0:8312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 51 00000100:00080000:2.0:1782239976.896050:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1782239976.896067:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782239976.896469:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a9cd392c/0x8c5345f1c1ec58c6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239976.896486:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5ee29fa00 already unused, calling callback (ffffffffc1728ce0) 00010000:00010000:2.0:1782239976.896491:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9cd392c/0x8c5345f1c1ec58c6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239976.896519:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9cd392c/0x8c5345f1c1ec58c6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239976.896543:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a9cd392c/0x8c5345f1c1ec58c6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239976.896552:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a9cd392c/0x8c5345f1c1ec58c6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239976.896576:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782239976.896579:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782239976.896581:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782239976.896927:0:3306:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:0.0:1782239976.896935:0:3306:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:0.0:1782239976.896976:0:3306:0:(client.c:3155:ptlrpc_free_committed()) @@@ stopping search req@ffff9bb5eddf6d80 x1868813758968064/t4294967307(4294967307) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1782239992 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1782239976.896990:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bb5eddf6d80/2, rc 0, transno 4294967307 00000100:00100000:0.0:1782239976.896996:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5eddf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813758968064:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1782239976.904354:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239976.907962:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737997952 00000100:00100000:3.0:1782239976.907984:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737997952 00000100:00100000:3.0:1782239976.908094:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 49 00000100:00100000:3.0:1782239976.908107:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5eddf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+21:11489:x1868813737997952:12345-192.168.203.32@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1782239976.908451:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5eddf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+22:11489:x1868813737997952:12345-192.168.203.32@tcp:35:lhsmtool_posix.0 Request processed in 345us (4106us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1782239976.908460:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 49 00000100:00100000:2.0:1782239976.919927:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239976.921538:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737998208 00000100:00100000:3.0:1782239976.921555:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737998208 00000100:00100000:3.0:1782239976.921639:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 180 00000100:00100000:3.0:1782239976.921652:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f77f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+22:11489:x1868813737998208:12345-192.168.203.32@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1782239976.921845:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f77f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+22:11489:x1868813737998208:12345-192.168.203.32@tcp:57:lhsmtool_posix.0 Request processed in 194us (1942us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239976.921853:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 180 00000100:00100000:3.0:1782239976.925351:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239976.925507:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737998336 00000100:00100000:1.0:1782239976.925523:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737998336 00000100:00100000:1.0:1782239976.925605:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 181 00000100:00100000:1.0:1782239976.925618:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb6018ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+22:11489:x1868813737998336:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782239976.925647:0:6611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782239976.925673:0:6611:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39000/0x8c5345f1c1ec58cd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e75c expref: -99 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239976.925794:0:6611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38a00/0x8c5345f1c1ec58d4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239976.925811:0:6611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38a00/0x8c5345f1c1ec58d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239976.925826:0:6611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38a00/0x8c5345f1c1ec58d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782239976.925883:0:6611:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782239976.925906:0:6611:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38a00/0x8c5345f1c1ec58d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239976.925948:0:6611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39000/0x8c5345f1c1ec58cd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e75c expref: 24 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239976.925970:0:6611:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38a00/0x8c5345f1c1ec58d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e75c expref: 23 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239976.925979:0:6611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9bb5c30e4e00) 00010000:00010000:1.0:1782239976.925983:0:6611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1782239976.925987:0:6611:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5f7e38a00, rc 0) 00000100:00100000:1.0:1782239976.926069:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb6018ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+23:11489:x1868813737998336:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 454us (734us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239976.926078:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 181 00000100:00100000:2.0:1782239976.938313:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239976.939239:0:8312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737998464 00000100:00100000:3.0:1782239976.939254:0:8312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737998464 00000100:00100000:3.0:1782239976.939326:0:8312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 52 00000100:00100000:3.0:1782239976.939339:0:8312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f77f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+7:2346:x1868813737998464:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782239976.939365:0:8312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782239976.939392:0:8312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000549c5075/0x8c5345f1c1ec58db lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e763 expref: -99 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782239976.939429:0:8312:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a3ad2e8, blocks: 0x1 00010000:00010000:3.0:1782239976.939454:0:8312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=356s v=(0 0) 00010000:00010000:3.0:1782239976.939458:0:8312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782239976.939471:0:8312:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000549c5075/0x8c5345f1c1ec58db lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e763 expref: 8 pid: 8312 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239976.939497:0:8312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000549c5075/0x8c5345f1c1ec58db lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e763 expref: 8 pid: 8312 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239976.939513:0:8312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5f7e26600, rc 0) 00000100:00100000:3.0:1782239976.939591:0:8312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f77f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+8:2346:x1868813737998464:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 255us (1293us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239976.939598:0:8312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 52 00000100:00100000:0.0:1782239976.952938:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239976.953201:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737998720 00000100:00100000:3.0:1782239976.953216:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737998720 00000100:00100000:3.0:1782239976.953303:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 182 00000100:00100000:3.0:1782239976.953315:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5dee27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+23:11489:x1868813737998720:12345-192.168.203.32@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1782239976.953468:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5dee27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+23:11489:x1868813737998720:12345-192.168.203.32@tcp:57:lhsmtool_posix.0 Request processed in 154us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239976.953491:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 182 00000100:00100000:1.0:1782239976.958253:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239976.958387:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737998848 00000100:00100000:3.0:1782239976.958401:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737998848 00000100:00100000:2.0:1782239976.960528:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 53 00000100:00100000:2.0:1782239976.960556:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5eddf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+8:11489:x1868813737998848:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782239976.960583:0:6589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782239976.960610:0:6589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd087e1a/0x8c5345f1c1ec58e2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e76a expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239976.960650:0:6589:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000549c5075/0x8c5345f1c1ec58db lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e763 expref: 9 pid: 8312 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239976.960661:0:6589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782239976.960666:0:6589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782239976.960686:0:6589:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd087e1a/0x8c5345f1c1ec58e2 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e76a expref: 9 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239976.960733:0:6589:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000549c5075/0x8c5345f1c1ec58db lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e763 expref: 9 pid: 8312 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239976.965375:0:6589:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000549c5075/0x8c5345f1c1ec58db lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e763 expref: 9 pid: 8312 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239976.965418:0:6589:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f77f1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6589:1868813758968192:192.168.203.32@tcp:104: 00000100:00100000:2.0:1782239976.965568:0:6589:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5d1cd03c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782239976.972716:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239976.973185:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737998976 00000100:00100000:1.0:1782239976.973198:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737998976 00010000:00010000:1.0:1782239976.973326:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000549c5075/0x8c5345f1c1ec58db lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e763 expref: 10 pid: 8312 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239976.973379:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 67 00000100:00100000:1.0:1782239976.973391:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5dee24380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+10:2345:x1868813737998976:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782239976.973412:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782239976.973441:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000549c5075/0x8c5345f1c1ec58db lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e763 expref: 10 pid: 8312 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239976.973472:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000549c5075/0x8c5345f1c1ec58db lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e763 expref: 10 pid: 8312 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239976.973506:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782239976.973511:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782239976.973520:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fd087e1a/0x8c5345f1c1ec58e2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e76a expref: 10 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239976.973532:0:5777:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd087e1a/0x8c5345f1c1ec58e2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e76a expref: 10 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239976.973582:0:5777:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000fd087e1a/0x8c5345f1c1ec58e2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e76a expref: 10 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239976.973600:0:5777:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb60135bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5777:1868813758968320:192.168.203.32@tcp:105: 00000100:00100000:1.0:1782239976.973711:0:5777:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5f7b47840 going to sleep for 11 seconds 00010000:00010000:3.0:1782239976.977519:0:6589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000549c5075/0x8c5345f1c1ec58db lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e763 expref: 10 pid: 8312 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239976.977554:0:6589:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f77f1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6589:1868813758968192:192.168.203.32@tcp:104: 00010000:00010000:3.0:1782239976.977595:0:6589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fd087e1a/0x8c5345f1c1ec58e2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e76a expref: 9 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239976.977614:0:6589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5ee29ea00, rc 0) 00000100:00100000:3.0:1782239976.977702:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5eddf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+9:11489:x1868813737998848:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 17159us (19472us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239976.977712:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 53 00000100:00100000:1.0:1782239976.978738:0:5777:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb60135bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5777:1868813758968320:192.168.203.32@tcp:105: 00010000:00010000:1.0:1782239976.979366:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782239976.979445:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5dee24380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+8:2345:x1868813737998976:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 6054us (6742us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239976.979459:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 67 00000100:00100000:3.0:1782239976.984219:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239976.984912:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737999104 00000100:00100000:2.0:1782239976.984937:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737999104 00002000:00100000:2.0:1782239976.985008:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9bb6018cf480 x1868813737999104/t0(0) o4->36dd742b-25b8-431e-bf41-75f2fff47ffb@192.168.203.32@tcp:577/0 lens 504/0 e 0 to 0 dl 1782239987 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782239976.985025:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9bb6018cf480 with x1868813737999104 ext(0->8) 00002000:00010000:2.0:1782239976.985033:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bb6018cf480 00000100:00100000:2.0:1782239976.986370:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 4 00000100:00100000:2.0:1782239976.986393:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb6018cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+8:2345:x1868813737999104:12345-192.168.203.32@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1782239976.987101:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb6018cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+10:2345:x1868813737999104:12345-192.168.203.32@tcp:4:lhsmtool_posix.0 Request processed in 712us (2892us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1782239976.987112:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 4 00002000:00100000:2.0:1782239976.987124:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9bb6018cf480 x1868813737999104/t4294967314(0) o4->36dd742b-25b8-431e-bf41-75f2fff47ffb@192.168.203.32@tcp:577/0 lens 504/448 e 0 to 0 dl 1782239987 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782239976.987136:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9bb6018cf480 with x1868813737999104 ext(0->8) 00002000:00010000:2.0:1782239976.987150:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bb6018cf480 00000100:00100000:3.0:1782239976.992153:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239976.993933:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737999232 00000100:00100000:2.0:1782239976.993956:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737999232 00000100:00100000:2.0:1782239976.994056:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 183 00000100:00100000:2.0:1782239976.994069:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb6018cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+23:11489:x1868813737999232:12345-192.168.203.32@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1782239977.061692:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb6018cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+23:11489:x1868813737999232:12345-192.168.203.32@tcp:44:lhsmtool_posix.0 Request processed in 67608us (70456us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239977.061708:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 183 00000020:00080000:3.0:1782239977.061785:0:5812:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000001:00080000:3.0:1782239977.061806:0:5812:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967459 is committed 00000001:00080000:3.0:1782239977.061820:0:5812:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967461 is committed 00000004:00080000:3.0:1782239977.061829:0:5812:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000020:00080000:3.0:1782239977.061998:0:5823:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:3.0:1782239977.062013:0:5823:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1782239977.062155:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb6018cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1868813758968448:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1782239977.063141:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239977.063349:0:8312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758968448 00000100:00100000:0.0:1782239977.063362:0:8312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758968448 00000100:00100000:0.0:1782239977.063444:0:8312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1782239977.063456:0:8312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb6018cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1868813758968448:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1782239977.063688:0:8312:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1782239977.063692:0:8312:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1782239977 00002000:00010000:0.0:1782239977.063695:0:8312:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1782239977.063698:0:8312:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1782239976 -> 1782239977 00002000:00010000:0.0:1782239977.063701:0:8312:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1782239977.063794:0:8312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb6018cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3307:x1868813758968448:12345-0@lo:2:osp-syn-0-0.0 Request processed in 341us (658us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1782239977.063802:0:8312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:1.0:1782239977.063961:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1782239977.064060:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bb6018cf100/2, rc 0, transno 4294967315 00000100:00100000:3.0:1782239977.064068:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb6018cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1868813758968448:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1782239977.066408:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239977.066638:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737999360 00000100:00100000:2.0:1782239977.066654:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737999360 00000100:00100000:2.0:1782239977.066790:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 55 00000100:00100000:2.0:1782239977.066803:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb60135bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+10:2344:x1868813737999360:12345-192.168.203.32@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1782239977.142569:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb60135bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+10:2344:x1868813737999360:12345-192.168.203.32@tcp:16:lhsmtool_posix.0 Request processed in 75752us (76159us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239977.142586:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 55 00000001:00080000:2.0:1782239977.142634:0:6614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000001:00080000:2.0:1782239977.142650:0:6614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000100:00100000:3.0:1782239977.150277:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239977.151002:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737999616 00000100:00100000:1.0:1782239977.151030:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737999616 00000100:00100000:1.0:1782239977.151102:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 184 00000100:00100000:1.0:1782239977.151115:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ffd6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+19:11489:x1868813737999616:12345-192.168.203.32@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1782239977.151212:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782239977.151261:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38a00/0x8c5345f1c1ec58d4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e75c expref: 19 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239977.151285:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9bb5c30e4e00) 00010000:00010000:1.0:1782239977.151291:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782239977.151329:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39200/0x8c5345f1c1ec58e9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239977.151345:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39200/0x8c5345f1c1ec58e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239977.151356:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39200/0x8c5345f1c1ec58e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782239977.151732:0:5790:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003704479a reply state 00000000020abed2 transno 4294967462 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39200/0x8c5345f1c1ec58e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239977.151744:0:5790:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782239977.151904:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ffd6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+20:11489:x1868813737999616:12345-192.168.203.32@tcp:36:lhsmtool_posix.0 Request processed in 790us (1640us total) trans 4294967462 rc 0/0 00000100:00100000:1.0:1782239977.151913:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 184 00000100:00100000:2.0:1782239977.156511:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00010000:00010000:0.0:1782239977.156698:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39200/0x8c5345f1c1ec58e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239977.156714:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39200/0x8c5345f1c1ec58e9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239977.156722:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39200/0x8c5345f1c1ec58e9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239977.156729:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f7e39200 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:0.0:1782239977.156735:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39200/0x8c5345f1c1ec58e9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239977.156779:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39200/0x8c5345f1c1ec58e9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239977.156801:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9bb5c30e4e00) 00010000:00010000:0.0:1782239977.156805:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782239977.156810:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39200/0x8c5345f1c1ec58e9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239977.156818:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39200/0x8c5345f1c1ec58e9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782239977.156859:0:8312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813737999744 00000100:00100000:0.0:1782239977.156870:0:8312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813737999744 00000100:00100000:0.0:1782239977.156940:0:8312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 56 00000100:00100000:0.0:1782239977.156951:0:8312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f77f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+7:2345:x1868813737999744:12345-192.168.203.32@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1782239977.157352:0:8312:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1782239977.157356:0:8312:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1782239977 -> 1782239975 00002000:00010000:0.0:1782239977.157359:0:8312:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1782239973 00002000:00010000:0.0:1782239977.157362:0:8312:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1782239977 -> 1782239975 00002000:00010000:0.0:1782239977.157364:0:8312:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1782239977.157435:0:8312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f77f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+8:2345:x1868813737999744:12345-192.168.203.32@tcp:2:lhsmtool_posix.0 Request processed in 485us (944us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1782239977.157445:0:8312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 56 00000100:00100000:2.0:1782239977.167960:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239977.170579:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738000000 00000100:00100000:3.0:1782239977.170603:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738000000 00000100:00100000:3.0:1782239977.170709:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 185 00000100:00100000:3.0:1782239977.170722:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+19:11489:x1868813738000000:12345-192.168.203.32@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1782239977.170841:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26000/0x8c5345f1c1ec58f0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239977.170865:0:5792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38c00/0x8c5345f1c1ec58b1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e74e expref: 19 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239977.170878:0:5792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26000/0x8c5345f1c1ec58f0 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239977.170934:0:5792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38c00/0x8c5345f1c1ec58b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e74e expref: 19 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239977.170951:0:5792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38c00/0x8c5345f1c1ec58b1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e74e expref: 19 pid: 6611 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239977.170969:0:5792:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5ffd6c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5792:1868813758968576:192.168.203.32@tcp:104: 00000100:00100000:3.0:1782239977.171097:0:5792:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5ee3c66c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782239977.175548:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239977.175590:0:7481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738000128 00000100:00100000:3.0:1782239977.175616:0:7481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738000128 00010000:00010000:3.0:1782239977.175669:0:7481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38c00/0x8c5345f1c1ec58b1 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e74e expref: 20 pid: 6611 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239977.175710:0:7481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 68 00000100:00100000:3.0:1782239977.175720:0:7481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ffd6d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+20:2345:x1868813738000128:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782239977.175739:0:7481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782239977.175775:0:7481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38c00/0x8c5345f1c1ec58b1 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e74e expref: 20 pid: 6611 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239977.175791:0:7481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38c00/0x8c5345f1c1ec58b1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e74e expref: 20 pid: 6611 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239977.175819:0:7481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9bb5c30e4e00) 00010000:00010000:3.0:1782239977.175825:0:7481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26000/0x8c5345f1c1ec58f0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239977.175837:0:7481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26000/0x8c5345f1c1ec58f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239977.175846:0:7481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26000/0x8c5345f1c1ec58f0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239977.175870:0:7481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782239977.175945:0:7481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ffd6d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+20:2345:x1868813738000128:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 225us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239977.175954:0:7481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 68 00010000:00010000:2.0:1782239977.176230:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38c00/0x8c5345f1c1ec58b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e74e expref: 19 pid: 6611 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239977.176250:0:5792:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5ffd6c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5792:1868813758968576:192.168.203.32@tcp:104: 00010000:00010000:2.0:1782239977.176279:0:5792:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26000/0x8c5345f1c1ec58f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239977.176298:0:5792:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26000/0x8c5345f1c1ec58f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239977.176305:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26000/0x8c5345f1c1ec58f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239977.176353:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26000/0x8c5345f1c1ec58f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239977.176361:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26000/0x8c5345f1c1ec58f0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239977.176369:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26000/0x8c5345f1c1ec58f0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239977.176375:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f7e26000 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:2.0:1782239977.176380:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26000/0x8c5345f1c1ec58f0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239977.176387:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26000/0x8c5345f1c1ec58f0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239977.176396:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9bb5c30e4e00) 00010000:00010000:2.0:1782239977.176399:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1782239977.176402:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26000/0x8c5345f1c1ec58f0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239977.176408:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26000/0x8c5345f1c1ec58f0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239977.176468:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+18:11489:x1868813738000000:12345-192.168.203.32@tcp:55:lhsmtool_posix.0 Request processed in 5749us (8527us total) trans 0 rc -22/-22 00000100:00100000:2.0:1782239977.176478:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 185 00000100:00100000:3.0:1782239977.185164:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239977.185393:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738000256 00000100:00100000:0.0:1782239977.185410:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738000256 00000100:00100000:0.0:1782239977.185495:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 57 00000100:00100000:0.0:1782239977.185510:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ffd6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+8:2344:x1868813738000256:12345-192.168.203.32@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1782239977.185633:0:6589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f2533037/0x8c5345f1c1ec58f7 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239977.185667:0:6589:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fd087e1a/0x8c5345f1c1ec58e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e76a expref: 8 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239977.185679:0:6589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782239977.185685:0:6589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782239977.185690:0:6589:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f2533037/0x8c5345f1c1ec58f7 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239977.185743:0:6589:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fd087e1a/0x8c5345f1c1ec58e2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e76a expref: 8 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239977.185807:0:6589:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fd087e1a/0x8c5345f1c1ec58e2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e76a expref: 8 pid: 6589 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782239977.185825:0:6589:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f7810700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6589:1868813758968704:192.168.203.32@tcp:104: 00000100:00100000:0.0:1782239977.185942:0:6589:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5f7b47780 going to sleep for 11 seconds 00000100:00100000:3.0:1782239977.199980:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239977.200042:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738000384 00000100:00100000:3.0:1782239977.200054:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738000384 00010000:00010000:3.0:1782239977.200107:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fd087e1a/0x8c5345f1c1ec58e2 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e76a expref: 9 pid: 6589 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239977.200148:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 69 00000100:00100000:3.0:1782239977.200160:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d0219850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+9:2345:x1868813738000384:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782239977.200179:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782239977.200217:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fd087e1a/0x8c5345f1c1ec58e2 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e76a expref: 9 pid: 6589 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239977.200936:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fd087e1a/0x8c5345f1c1ec58e2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e76a expref: 9 pid: 6589 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239977.200977:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782239977.200982:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782239977.200990:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f2533037/0x8c5345f1c1ec58f7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239977.201002:0:5775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f2533037/0x8c5345f1c1ec58f7 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239977.201032:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782239977.201140:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d0219850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+9:2345:x1868813738000384:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 981us (1175us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239977.201152:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 69 00010000:00010000:1.0:1782239977.201477:0:6589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd087e1a/0x8c5345f1c1ec58e2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e76a expref: 8 pid: 6589 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239977.201497:0:6589:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f7810700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6589:1868813758968704:192.168.203.32@tcp:104: 00010000:00010000:1.0:1782239977.201533:0:6589:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f2533037/0x8c5345f1c1ec58f7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239977.201558:0:6589:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f2533037/0x8c5345f1c1ec58f7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239977.201566:0:6589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f2533037/0x8c5345f1c1ec58f7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239977.201602:0:6589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f2533037/0x8c5345f1c1ec58f7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239977.201613:0:6589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f2533037/0x8c5345f1c1ec58f7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239977.201623:0:6589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f2533037/0x8c5345f1c1ec58f7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239977.201630:0:6589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f4436800 already unused, calling callback (ffffffffc1728ce0) 00010000:00010000:1.0:1782239977.201635:0:6589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2533037/0x8c5345f1c1ec58f7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239977.201645:0:6589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2533037/0x8c5345f1c1ec58f7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239977.201661:0:6589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f2533037/0x8c5345f1c1ec58f7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239977.201675:0:6589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f2533037/0x8c5345f1c1ec58f7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239977.201740:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ffd6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+7:2344:x1868813738000256:12345-192.168.203.32@tcp:1:lhsmtool_posix.0 Request processed in 16234us (16589us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239977.201774:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 57 00000100:00100000:3.0:1782239977.215095:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239977.217418:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738000640 00000100:00100000:1.0:1782239977.217441:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738000640 00000100:00100000:1.0:1782239977.218247:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 186 00000100:00100000:1.0:1782239977.218264:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ffd6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+18:11489:x1868813738000640:12345-192.168.203.32@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1782239977.218379:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38a00/0x8c5345f1c1ec58fe lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239977.218402:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38a00/0x8c5345f1c1ec58fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239977.218417:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38a00/0x8c5345f1c1ec58fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239977.218682:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39400/0x8c5345f1c1ec5905 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239977.218695:0:5790:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38000/0x8c5345f1c1ec58bf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e755 expref: 19 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239977.218704:0:5790:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39400/0x8c5345f1c1ec5905 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239977.218790:0:5790:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38000/0x8c5345f1c1ec58bf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e755 expref: 19 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239977.218808:0:5790:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38000/0x8c5345f1c1ec58bf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e755 expref: 19 pid: 6611 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239977.218827:0:5790:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb60135b480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5790:1868813758968832:192.168.203.32@tcp:104: 00000100:00100000:1.0:1782239977.218959:0:5790:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c1254300 going to sleep for 11 seconds 00000100:00100000:2.0:1782239977.225891:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239977.226591:0:7481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738000768 00000100:00100000:3.0:1782239977.226607:0:7481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738000768 00010000:00010000:3.0:1782239977.226666:0:7481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38000/0x8c5345f1c1ec58bf lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e755 expref: 20 pid: 6611 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239977.226719:0:7481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 70 00000100:00100000:3.0:1782239977.226730:0:7481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48ed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+20:2344:x1868813738000768:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782239977.226782:0:7481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782239977.226792:0:7481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38000/0x8c5345f1c1ec58bf lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e755 expref: 20 pid: 6611 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239977.226808:0:7481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38000/0x8c5345f1c1ec58bf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e755 expref: 20 pid: 6611 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239977.226839:0:7481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9bb5c30e4e00) 00010000:00010000:3.0:1782239977.226846:0:7481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39400/0x8c5345f1c1ec5905 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239977.226858:0:7481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39400/0x8c5345f1c1ec5905 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239977.226866:0:7481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39400/0x8c5345f1c1ec5905 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239977.226892:0:7481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782239977.226980:0:7481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48ed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+20:2344:x1868813738000768:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 251us (1104us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239977.226990:0:7481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 70 00010000:00010000:3.0:1782239977.227157:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38000/0x8c5345f1c1ec58bf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e755 expref: 19 pid: 6611 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239977.227194:0:5790:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb60135b480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5790:1868813758968832:192.168.203.32@tcp:104: 00010000:00010000:3.0:1782239977.227241:0:5790:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39400/0x8c5345f1c1ec5905 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239977.227253:0:5790:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39400/0x8c5345f1c1ec5905 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239977.227260:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39400/0x8c5345f1c1ec5905 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782239977.230804:0:5790:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:3.0:1782239977.231018:0:5790:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:3.0:1782239977.231067:0:5790:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:3.0:1782239977.231184:0:5790:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5ffd6f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5790:1868813758968960:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1782239977.232087:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239977.232141:0:5790:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5ee3c6cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1782239977.237084:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758968960 00000100:00100000:1.0:1782239977.237108:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758968960 00000100:00100000:1.0:1782239977.237416:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1782239977.237431:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ffd6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5790:x1868813758968960:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1782239977.237601:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ffd6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5790:x1868813758968960:12345-0@lo:1000:mdt00_000.0 Request processed in 173us (5517us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239977.237610:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1782239977.237694:0:5790:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:0.0:1782239977.237703:0:5790:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bb6018cf100, transno 4294967315 00000100:00100000:0.0:1782239977.237726:0:5790:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5ffd6f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5790:1868813758968960:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1782239977.238386:0:5790:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:0.0:1782239977.238493:0:5790:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f7811500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5790:1868813758969088:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1782239977.238553:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239977.244390:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758969088 00000100:00100000:2.0:1782239977.244406:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758969088 00000100:00100000:2.0:1782239977.244488:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1782239977.244499:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7811880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5790:x1868813758969088:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1782239977.244894:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7811880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5790:x1868813758969088:12345-0@lo:1000:mdt00_000.0 Request processed in 395us (6339us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1782239977.244904:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1782239977.245121:0:5790:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5f7b47840 going to sleep for 11 seconds 00000100:00100000:0.0:1782239977.245160:0:5790:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f7811500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5790:1868813758969088:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1782239977.245283:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39400/0x8c5345f1c1ec5905 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239977.245357:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39400/0x8c5345f1c1ec5905 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239977.245366:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39400/0x8c5345f1c1ec5905 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239977.245375:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f7e39400 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:0.0:1782239977.245381:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39400/0x8c5345f1c1ec5905 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239977.245391:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39400/0x8c5345f1c1ec5905 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239977.245412:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9bb5c30e4e00) 00010000:00010000:0.0:1782239977.245415:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782239977.245421:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39400/0x8c5345f1c1ec5905 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239977.245427:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39400/0x8c5345f1c1ec5905 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239977.245468:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39e00/0x8c5345f1c1ec583a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239977.245475:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39e00/0x8c5345f1c1ec583a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239977.245482:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39e00/0x8c5345f1c1ec583a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239977.245502:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f7e39e00 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:0.0:1782239977.245506:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39e00/0x8c5345f1c1ec583a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239977.245513:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39e00/0x8c5345f1c1ec583a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239977.245522:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bb5c30e4900) 00010000:00010000:0.0:1782239977.245525:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782239977.245528:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39e00/0x8c5345f1c1ec583a lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239977.245535:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39e00/0x8c5345f1c1ec583a lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239977.245558:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437400/0x8c5345f1c1ec590c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239977.245576:0:5790:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436e00/0x8c5345f1c1ec5856 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e739 expref: 22 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239977.245586:0:5790:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437400/0x8c5345f1c1ec590c lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239977.245633:0:5790:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436e00/0x8c5345f1c1ec5856 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e739 expref: 22 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239977.245653:0:5790:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436e00/0x8c5345f1c1ec5856 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e739 expref: 22 pid: 5791 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782239977.245685:0:5790:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f7812a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5790:1868813758969216:192.168.203.32@tcp:104: 00000100:00100000:0.0:1782239977.245985:0:5790:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5f7b47840 going to sleep for 11 seconds 00000100:00100000:3.0:1782239977.264631:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239977.264820:0:5790:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f7812a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5790:1868813758969216:192.168.203.32@tcp:104: 00010000:00010000:1.0:1782239977.264856:0:5790:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437400/0x8c5345f1c1ec590c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239977.267846:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738000896 00000100:00100000:1.0:1782239977.267868:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738000896 00010000:00010000:1.0:1782239977.267938:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436e00/0x8c5345f1c1ec5856 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e739 expref: 23 pid: 5791 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239977.267985:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 71 00000100:00100000:1.0:1782239977.267997:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ffd6f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+23:2345:x1868813738000896:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782239977.268028:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782239977.268037:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436e00/0x8c5345f1c1ec5856 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e739 expref: 23 pid: 5791 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239977.268053:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436e00/0x8c5345f1c1ec5856 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e739 expref: 23 pid: 5791 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239977.268082:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436e00/0x8c5345f1c1ec5856 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e739 expref: 23 pid: 5791 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239977.268102:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bb5c30e4900) 00010000:00010000:1.0:1782239977.268107:0:5777:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437400/0x8c5345f1c1ec590c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239977.268120:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437400/0x8c5345f1c1ec590c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239977.268129:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437400/0x8c5345f1c1ec590c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239977.268164:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782239977.268261:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ffd6f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+22:2345:x1868813738000896:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 265us (3643us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239977.268270:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 71 00010000:00010000:1.0:1782239977.268564:0:5790:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437400/0x8c5345f1c1ec590c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239977.268573:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437400/0x8c5345f1c1ec590c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239977.268598:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437400/0x8c5345f1c1ec590c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239977.268604:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437400/0x8c5345f1c1ec590c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239977.268612:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437400/0x8c5345f1c1ec590c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239977.268620:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f4437400 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:1.0:1782239977.268625:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437400/0x8c5345f1c1ec590c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239977.268633:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437400/0x8c5345f1c1ec590c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239977.268643:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bb5c30e4900) 00010000:00010000:1.0:1782239977.268645:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782239977.268649:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437400/0x8c5345f1c1ec590c lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239977.268655:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437400/0x8c5345f1c1ec590c lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239977.268666:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38a00/0x8c5345f1c1ec58fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239977.268670:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38a00/0x8c5345f1c1ec58fe lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239977.268675:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38a00/0x8c5345f1c1ec58fe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239977.268688:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f7e38a00 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:1.0:1782239977.268690:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38a00/0x8c5345f1c1ec58fe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239977.268696:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38a00/0x8c5345f1c1ec58fe lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239977.268702:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bb5c30e4900) 00010000:00010000:1.0:1782239977.268704:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1782239977.268707:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38a00/0x8c5345f1c1ec58fe lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239977.268712:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38a00/0x8c5345f1c1ec58fe lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239977.269016:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ffd6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+21:11489:x1868813738000640:12345-192.168.203.32@tcp:57:lhsmtool_posix.0 Request processed in 50755us (53934us total) trans 4294967467 rc 0/0 00000100:00100000:1.0:1782239977.269028:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 186 00000020:00080000:1.0:1782239977.269032:0:5790:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1782239977.269163:0:11535:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1782239977.269168:0:11535:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:3.0:1782239977.273787:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239977.274661:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738001152 00000100:00100000:2.0:1782239977.274678:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738001152 00000100:00100000:2.0:1782239977.274780:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 50 00000100:00100000:2.0:1782239977.274794:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5c779f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+21:11489:x1868813738001152:12345-192.168.203.32@tcp:35:lhsmtool_posix.0 00000040:00080000:1.0:1782239977.275456:0:11535:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:1.0:1782239977.275472:0:11535:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000004:00080000:2.0:1782239977.277444:0:5794:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1782239977.277584:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967468 00010000:00010000:2.0:1782239977.277679:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fc00/0x8c5345f1c1ec5913 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239977.277700:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fc00/0x8c5345f1c1ec5913 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239977.277714:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fc00/0x8c5345f1c1ec5913 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239977.277724:0:5794:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fc00/0x8c5345f1c1ec5913 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239977.277731:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fc00/0x8c5345f1c1ec5913 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239977.277738:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fc00/0x8c5345f1c1ec5913 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239977.277786:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1782239977.277970:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5c779f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+23:11489:x1868813738001152:12345-192.168.203.32@tcp:35:lhsmtool_posix.0 Request processed in 3173us (4191us total) trans 4294967469 rc 0/0 00000100:00100000:2.0:1782239977.277983:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 50 00000020:00080000:2.0:1782239977.277990:0:5794:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1782239977.279391:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782239977.279405:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fc00/0x8c5345f1c1ec5913 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239977.279418:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5ee29fc00 already unused, calling callback (ffffffffc1728ce0) 00010000:00010000:3.0:1782239977.279424:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fc00/0x8c5345f1c1ec5913 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239977.279435:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fc00/0x8c5345f1c1ec5913 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239977.279471:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9bb5c4ed6300) 00010000:00010000:3.0:1782239977.279475:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782239977.279480:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fc00/0x8c5345f1c1ec5913 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239977.279489:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fc00/0x8c5345f1c1ec5913 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239977.279513:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782239977.279516:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782239977.279518:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1782239977.346550:0:12264:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1782239977.346564:0:12264:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1782239977.346615:0:12264:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1782239977.346622:0:12264:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1782239977.478093:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239977.478165:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738001408 00000100:00100000:3.0:1782239977.478181:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738001408 00000100:00100000:3.0:1782239977.480466:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 187 00000100:00100000:3.0:1782239977.480495:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb60135b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+23:11500:x1868813738001408:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:3.0:1782239977.480531:0:6611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782239977.480558:0:6611:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27c00/0x8c5345f1c1ec591a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e771 expref: -99 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239977.480926:0:6611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26600/0x8c5345f1c1ec5921 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239977.480946:0:6611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26600/0x8c5345f1c1ec5921 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239977.480960:0:6611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26600/0x8c5345f1c1ec5921 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782239977.480973:0:6611:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:3.0:1782239977.481177:0:6611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27c00/0x8c5345f1c1ec591a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e771 expref: 26 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239977.481216:0:6611:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26600/0x8c5345f1c1ec5921 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e771 expref: 25 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239977.481227:0:6611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bb5c30e4000) 00010000:00010000:3.0:1782239977.481230:0:6611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1782239977.481233:0:6611:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5f7e26600, rc 0) 00000100:00100000:3.0:1782239977.483518:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb60135b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+25:11500:x1868813738001408:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 3018us (5422us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1782239977.483534:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 187 00000100:00100000:1.0:1782239977.486829:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239977.492624:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738001536 00000100:00100000:3.0:1782239977.492644:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738001536 00000100:00100000:3.0:1782239977.492724:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 188 00000100:00100000:3.0:1782239977.492737:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7d0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+25:11500:x1868813738001536:12345-192.168.203.32@tcp:34:lfs.0 00010000:00010000:3.0:1782239977.492854:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26800/0x8c5345f1c1ec592f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239977.492875:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26800/0x8c5345f1c1ec592f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239977.492888:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26800/0x8c5345f1c1ec592f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239977.492905:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27a00/0x8c5345f1c1ec5936 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239977.492913:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27a00/0x8c5345f1c1ec5936 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239977.492946:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27a00/0x8c5345f1c1ec5936 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239977.493320:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27200/0x8c5345f1c1ec593d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239977.493330:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27200/0x8c5345f1c1ec593d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239977.493338:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27200/0x8c5345f1c1ec593d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782239977.493392:0:5790:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27200/0x8c5345f1c1ec593d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239977.493406:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26800/0x8c5345f1c1ec592f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239977.493414:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26800/0x8c5345f1c1ec592f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239977.493421:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26800/0x8c5345f1c1ec592f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239977.493428:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f7e26800 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:3.0:1782239977.493432:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26800/0x8c5345f1c1ec592f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239977.493440:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26800/0x8c5345f1c1ec592f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239977.493454:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bb5c30e4000) 00010000:00010000:3.0:1782239977.493462:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782239977.493468:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26800/0x8c5345f1c1ec592f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239977.493476:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26800/0x8c5345f1c1ec592f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239977.493491:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27a00/0x8c5345f1c1ec5936 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239977.493497:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27a00/0x8c5345f1c1ec5936 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239977.493502:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27a00/0x8c5345f1c1ec5936 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239977.493506:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f7e27a00 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:3.0:1782239977.493508:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27a00/0x8c5345f1c1ec5936 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239977.493514:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27a00/0x8c5345f1c1ec5936 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239977.493521:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bb5d0df4900) 00010000:00010000:3.0:1782239977.493523:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782239977.493526:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27a00/0x8c5345f1c1ec5936 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239977.493530:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27a00/0x8c5345f1c1ec5936 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239977.493546:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27200/0x8c5345f1c1ec593d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239977.493557:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27200/0x8c5345f1c1ec593d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239977.493563:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27200/0x8c5345f1c1ec593d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239977.493568:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f7e27200 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:3.0:1782239977.493572:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27200/0x8c5345f1c1ec593d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239977.493577:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27200/0x8c5345f1c1ec593d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239977.493585:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bb5d0df4100) 00010000:00010000:3.0:1782239977.493587:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782239977.493590:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27200/0x8c5345f1c1ec593d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239977.493595:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27200/0x8c5345f1c1ec593d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239977.493702:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7d0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+25:11500:x1868813738001536:12345-192.168.203.32@tcp:34:lfs.0 Request processed in 966us (6886us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239977.493712:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 188 00000100:00100000:0.0:1782239977.536448:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239977.537498:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738001792 00000100:00100000:1.0:1782239977.537518:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738001792 00000100:00100000:1.0:1782239977.537614:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 189 00000100:00100000:1.0:1782239977.537626:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7813b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+25:11503:x1868813738001792:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:1.0:1782239977.537673:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782239977.537702:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38200/0x8c5345f1c1ec5944 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e778 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239977.537836:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38a00/0x8c5345f1c1ec594b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239977.537855:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38a00/0x8c5345f1c1ec594b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239977.537871:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38a00/0x8c5345f1c1ec594b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239977.537888:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38800/0x8c5345f1c1ec5952 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239977.537895:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38800/0x8c5345f1c1ec5952 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239977.537903:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38800/0x8c5345f1c1ec5952 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239977.538387:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39e00/0x8c5345f1c1ec5959 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239977.538398:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39e00/0x8c5345f1c1ec5959 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239977.538405:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39e00/0x8c5345f1c1ec5959 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782239977.538417:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1782239977.538547:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38a00/0x8c5345f1c1ec594b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239977.538556:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38a00/0x8c5345f1c1ec594b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239977.538564:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38a00/0x8c5345f1c1ec594b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239977.538571:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f7e38a00 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:1.0:1782239977.538576:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38a00/0x8c5345f1c1ec594b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239977.538584:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38a00/0x8c5345f1c1ec594b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239977.538599:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bb5c30e4000) 00010000:00010000:1.0:1782239977.538602:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782239977.538608:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38a00/0x8c5345f1c1ec594b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239977.538615:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38a00/0x8c5345f1c1ec594b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239977.538631:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38800/0x8c5345f1c1ec5952 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239977.538637:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38800/0x8c5345f1c1ec5952 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239977.538644:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38800/0x8c5345f1c1ec5952 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239977.538650:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f7e38800 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:1.0:1782239977.538662:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38800/0x8c5345f1c1ec5952 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239977.538671:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38800/0x8c5345f1c1ec5952 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239977.538681:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bb5c30e4900) 00010000:00010000:1.0:1782239977.538685:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782239977.538689:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38800/0x8c5345f1c1ec5952 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239977.538696:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38800/0x8c5345f1c1ec5952 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239977.538786:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38200/0x8c5345f1c1ec5944 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e778 expref: 28 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239977.538804:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39e00/0x8c5345f1c1ec5959 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e778 expref: 27 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239977.538812:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bb5c30e4a00) 00010000:00010000:1.0:1782239977.538815:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782239977.538818:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5f7e39e00, rc 0) 00000100:00100000:1.0:1782239977.538908:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7813b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+27:11503:x1868813738001792:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 1284us (2468us total) trans 4294967471 rc 0/0 00000100:00100000:1.0:1782239977.538931:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 189 00000100:00100000:1.0:1782239977.546097:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239977.548202:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738001920 00000100:00100000:0.0:1782239977.548216:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738001920 00000100:00100000:0.0:1782239977.548289:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 190 00000100:00100000:0.0:1782239977.548301:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7d0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+27:11503:x1868813738001920:12345-192.168.203.32@tcp:54:lfs.0 00010000:00010000:0.0:1782239977.548368:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436000/0x8c5345f1c1ec5967 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239977.548385:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436000/0x8c5345f1c1ec5967 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239977.548396:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436000/0x8c5345f1c1ec5967 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239977.548433:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436000/0x8c5345f1c1ec5967 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239977.548441:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436000/0x8c5345f1c1ec5967 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239977.548447:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436000/0x8c5345f1c1ec5967 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239977.548472:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f4436000 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:0.0:1782239977.548481:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436000/0x8c5345f1c1ec5967 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239977.548490:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436000/0x8c5345f1c1ec5967 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239977.548503:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bb5c30e4a00) 00010000:00010000:0.0:1782239977.548507:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782239977.548512:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436000/0x8c5345f1c1ec5967 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239977.548517:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436000/0x8c5345f1c1ec5967 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782239977.548598:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7d0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+27:11503:x1868813738001920:12345-192.168.203.32@tcp:54:lfs.0 Request processed in 299us (2514us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239977.548606:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 190 00000100:00100000:0.0:1782239977.554186:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239977.554404:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738002176 00000100:00100000:3.0:1782239977.554415:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738002176 00000100:00100000:3.0:1782239977.554489:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 51 00000100:00100000:3.0:1782239977.554502:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7811f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+27:11503:x1868813738002176:12345-192.168.203.32@tcp:35:lfs.0 00000100:00100000:3.0:1782239977.554807:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7811f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+28:11503:x1868813738002176:12345-192.168.203.32@tcp:35:lfs.0 Request processed in 307us (637us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1782239977.554830:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 51 00000100:00100000:2.0:1782239977.620380:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239977.620729:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738002432 00000100:00100000:3.0:1782239977.620743:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738002432 00000100:00100000:3.0:1782239977.620950:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 191 00000100:00100000:3.0:1782239977.620962:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+28:11037:x1868813738002432:12345-192.168.203.32@tcp:101:bash.0 00010000:00010000:3.0:1782239977.620996:0:6611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782239977.621024:0:6611:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27600/0x8c5345f1c1ec596e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e77f expref: -99 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239977.621175:0:6611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27200/0x8c5345f1c1ec5975 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239977.621202:0:6611:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39e00/0x8c5345f1c1ec5959 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e778 expref: 29 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239977.621212:0:6611:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27200/0x8c5345f1c1ec5975 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239977.621257:0:6611:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39e00/0x8c5345f1c1ec5959 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e778 expref: 29 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239977.621274:0:6611:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39e00/0x8c5345f1c1ec5959 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e778 expref: 29 pid: 5790 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239977.621291:0:6611:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb6018cf100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6611:1868813758969344:192.168.203.32@tcp:104: 00000100:00100000:3.0:1782239977.621418:0:6611:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5d1cd03c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782239977.633322:0:6611:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb6018cf100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6611:1868813758969344:192.168.203.32@tcp:104: 00010000:00010000:3.0:1782239977.633372:0:6611:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27200/0x8c5345f1c1ec5975 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239977.633694:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239977.633738:0:7481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738002560 00000100:00100000:3.0:1782239977.633770:0:7481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738002560 00010000:00010000:3.0:1782239977.633821:0:7481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39e00/0x8c5345f1c1ec5959 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e778 expref: 30 pid: 5790 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239977.633865:0:7481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 72 00000100:00100000:3.0:1782239977.633877:0:7481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb6018cf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+30:2344:x1868813738002560:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782239977.633898:0:7481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782239977.633907:0:7481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39e00/0x8c5345f1c1ec5959 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e778 expref: 30 pid: 5790 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239977.633932:0:7481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39e00/0x8c5345f1c1ec5959 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e778 expref: 30 pid: 5790 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239977.633964:0:7481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39e00/0x8c5345f1c1ec5959 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e778 expref: 30 pid: 5790 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239977.633983:0:7481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bb5c30e4a00) 00010000:00010000:3.0:1782239977.633988:0:7481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27200/0x8c5345f1c1ec5975 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239977.634001:0:7481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27200/0x8c5345f1c1ec5975 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239977.634010:0:7481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27200/0x8c5345f1c1ec5975 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239977.634046:0:7481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782239977.634115:0:7481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb6018cf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+29:2344:x1868813738002560:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 239us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239977.634125:0:7481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 72 00010000:00010000:3.0:1782239977.634236:0:6611:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27200/0x8c5345f1c1ec5975 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239977.634244:0:6611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27200/0x8c5345f1c1ec5975 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782239977.634268:0:6611:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1782239977.634480:0:6611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27600/0x8c5345f1c1ec596e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e77f expref: 30 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239977.634501:0:6611:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27200/0x8c5345f1c1ec5975 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e77f expref: 29 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239977.634509:0:6611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bb5c30e4a00) 00010000:00010000:3.0:1782239977.634513:0:6611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1782239977.634516:0:6611:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5f7e27200, rc 0) 00000100:00100000:3.0:1782239977.635021:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+29:11037:x1868813738002432:12345-192.168.203.32@tcp:101:bash.0 Request processed in 14057us (14649us total) trans 4294967473 rc 0/0 00000100:00100000:3.0:1782239977.635032:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 191 00000100:00100000:3.0:1782239977.638831:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239977.643454:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738002816 00000100:00100000:0.0:1782239977.643480:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738002816 00000100:00100000:0.0:1782239977.643565:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 192 00000100:00100000:0.0:1782239977.643577:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fbf24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+29:11037:x1868813738002816:12345-192.168.203.32@tcp:36:bash.0 00010000:00010000:0.0:1782239977.643980:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436000/0x8c5345f1c1ec5983 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239977.644015:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436000/0x8c5345f1c1ec5983 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239977.644052:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436000/0x8c5345f1c1ec5983 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782239977.644118:0:5792:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000004:00010000:0.0:1782239977.644147:0:5792:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e5b8b1ca reply state 00000000f02897f2 transno 4294967475 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436000/0x8c5345f1c1ec5983 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782239977.644157:0:5792:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1782239977.644215:0:5792:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000100:00100000:0.0:1782239977.644383:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fbf24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+33:11037:x1868813738002816:12345-192.168.203.32@tcp:36:bash.0 Request processed in 807us (5565us total) trans 4294967476 rc 0/0 00000100:00100000:0.0:1782239977.644392:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 192 00000020:00080000:0.0:1782239977.644398:0:5792:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1782239977.651525:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436000/0x8c5345f1c1ec5983 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239977.651547:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436000/0x8c5345f1c1ec5983 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239977.652368:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436000/0x8c5345f1c1ec5983 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239977.652383:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f4436000 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:3.0:1782239977.652389:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436000/0x8c5345f1c1ec5983 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239977.652399:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436000/0x8c5345f1c1ec5983 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239977.652422:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bb5c30e4a00) 00010000:00010000:3.0:1782239977.652425:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782239977.652431:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436000/0x8c5345f1c1ec5983 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239977.652438:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436000/0x8c5345f1c1ec5983 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239977.659867:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239977.660149:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738002944 00000100:00100000:3.0:1782239977.660161:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738002944 00000100:00100000:3.0:1782239977.661785:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 193 00000100:00100000:3.0:1782239977.661804:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f780d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+32:11037:x1868813738002944:12345-192.168.203.32@tcp:101:bash.0 00010000:00010000:3.0:1782239977.661837:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782239977.661862:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27600/0x8c5345f1c1ec598a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e786 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239977.661951:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27600/0x8c5345f1c1ec598a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e786 expref: 33 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239977.661984:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27600/0x8c5345f1c1ec598a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e786 expref: 33 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239977.662009:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bb5c30e4a00) 00010000:00010000:3.0:1782239977.662012:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782239977.662016:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5f7e27600, rc 0) 00000100:00100000:3.0:1782239977.663003:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f780d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+33:11037:x1868813738002944:12345-192.168.203.32@tcp:101:bash.0 Request processed in 1198us (3139us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239977.663016:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 193 00000100:00100000:2.0:1782239977.666369:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239977.666815:0:8312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738003072 00000100:00100000:0.0:1782239977.666829:0:8312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738003072 00000100:00100000:0.0:1782239977.666893:0:8312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 58 00000100:00100000:0.0:1782239977.666903:0:8312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+7:11037:x1868813738003072:12345-192.168.203.32@tcp:101:bash.0 00010000:00010000:0.0:1782239977.666937:0:8312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782239977.666964:0:8312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b25db6fd/0x8c5345f1c1ec5991 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e78d expref: -99 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782239977.667075:0:8312:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a3ad2e7, atime: 0x6a3ad2e5, ctime: 0x6a3ad2e7, blocks: 0xb 00010000:00010000:0.0:1782239977.667106:0:8312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=356s v=(0 0) 00010000:00010000:0.0:1782239977.667111:0:8312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782239977.667122:0:8312:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b25db6fd/0x8c5345f1c1ec5991 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e78d expref: 8 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239977.667378:0:8312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b25db6fd/0x8c5345f1c1ec5991 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e78d expref: 8 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239977.667394:0:8312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5f4436200, rc 0) 00000100:00100000:0.0:1782239977.667477:0:8312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+8:11037:x1868813738003072:12345-192.168.203.32@tcp:101:bash.0 Request processed in 575us (1125us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239977.667486:0:8312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 58 00000100:00100000:3.0:1782239977.671027:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239977.671487:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738003200 00000100:00100000:3.0:1782239977.671500:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738003200 00002000:00010000:3.0:1782239977.671554:0:6594:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:3.0:1782239977.671560:0:6594:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9bb5f780d880 with x1868813738003200 ext(0->18446744073709551615) 00002000:00010000:3.0:1782239977.671583:0:6594:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bb5f780d880. 00000100:00100000:3.0:1782239977.671620:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 5 00000100:00100000:3.0:1782239977.671632:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f780d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+8:2345:x1868813738003200:12345-192.168.203.32@tcp:10:bash.0 00002000:00010000:3.0:1782239977.672030:0:6594:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1782239977.672035:0:6594:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1782239975 -> 1782239977 00002000:00010000:3.0:1782239977.672038:0:6594:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1782239973 -> 1782239973 00002000:00010000:3.0:1782239977.672040:0:6594:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1782239975 -> 1782239977 00002000:00010000:3.0:1782239977.672042:0:6594:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1782239977.672132:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f780d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+9:2345:x1868813738003200:12345-192.168.203.32@tcp:10:bash.0 Request processed in 501us (1119us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1782239977.672143:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 5 00002000:00010000:3.0:1782239977.672154:0:6594:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:3.0:1782239977.672157:0:6594:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9bb5f780d880 with x1868813738003200 ext(0->18446744073709551615) 00002000:00010000:3.0:1782239977.672162:0:6594:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bb5f780d880. 00010000:00010000:2.0:1782239977.697413:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782239977.774583:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239977.775034:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738003328 00000100:00100000:0.0:1782239977.775048:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738003328 00000100:00100000:0.0:1782239977.775138:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 194 00000100:00100000:0.0:1782239977.775150:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f780ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+33:11517:x1868813738003328:12345-192.168.203.32@tcp:34:lfs.0 00010000:00010000:0.0:1782239977.775267:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437000/0x8c5345f1c1ec5998 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239977.775290:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437000/0x8c5345f1c1ec5998 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239977.775303:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437000/0x8c5345f1c1ec5998 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239977.775320:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437200/0x8c5345f1c1ec599f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239977.775328:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437200/0x8c5345f1c1ec599f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239977.775334:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437200/0x8c5345f1c1ec599f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239977.775725:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437800/0x8c5345f1c1ec59a6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239977.775737:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437800/0x8c5345f1c1ec59a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239977.775806:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437800/0x8c5345f1c1ec59a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782239977.775859:0:5792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437800/0x8c5345f1c1ec59a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239977.775873:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437000/0x8c5345f1c1ec5998 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239977.775881:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437000/0x8c5345f1c1ec5998 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239977.775889:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437000/0x8c5345f1c1ec5998 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239977.775896:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f4437000 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:0.0:1782239977.775901:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437000/0x8c5345f1c1ec5998 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239977.775911:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437000/0x8c5345f1c1ec5998 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239977.775937:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bb5c30e4000) 00010000:00010000:0.0:1782239977.775940:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782239977.775945:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437000/0x8c5345f1c1ec5998 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239977.775960:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437000/0x8c5345f1c1ec5998 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239977.775975:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437200/0x8c5345f1c1ec599f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239977.775982:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437200/0x8c5345f1c1ec599f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239977.775988:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437200/0x8c5345f1c1ec599f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239977.775994:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f4437200 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:0.0:1782239977.775998:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437200/0x8c5345f1c1ec599f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239977.776004:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437200/0x8c5345f1c1ec599f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239977.776012:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bb5c55de700) 00010000:00010000:0.0:1782239977.776014:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782239977.776017:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437200/0x8c5345f1c1ec599f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239977.776024:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437200/0x8c5345f1c1ec599f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239977.776040:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437800/0x8c5345f1c1ec59a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239977.776047:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437800/0x8c5345f1c1ec59a6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239977.776058:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437800/0x8c5345f1c1ec59a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239977.776064:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f4437800 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:0.0:1782239977.776067:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437800/0x8c5345f1c1ec59a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239977.776073:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437800/0x8c5345f1c1ec59a6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239977.776081:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bb5c30e4a00) 00010000:00010000:0.0:1782239977.776084:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782239977.776086:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437800/0x8c5345f1c1ec59a6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239977.776092:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437800/0x8c5345f1c1ec59a6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782239977.776197:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f780ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+33:11517:x1868813738003328:12345-192.168.203.32@tcp:34:lfs.0 Request processed in 1047us (1627us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239977.776207:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 194 00000100:00100000:3.0:1782239977.820579:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239977.821513:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738003584 00000100:00100000:0.0:1782239977.821530:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738003584 00000100:00100000:2.0:1782239977.822361:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 195 00000100:00100000:2.0:1782239977.822455:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f77f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+33:11520:x1868813738003584:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:2.0:1782239977.822489:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782239977.822517:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e400/0x8c5345f1c1ec59ad lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e794 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239977.822727:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec59b4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239977.823025:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec59b4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239977.823051:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec59b4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239977.823178:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e600/0x8c5345f1c1ec59bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239977.823188:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e600/0x8c5345f1c1ec59bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239977.823252:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e600/0x8c5345f1c1ec59bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239977.824364:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fe00/0x8c5345f1c1ec59c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239977.824459:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fe00/0x8c5345f1c1ec59c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239977.824471:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fe00/0x8c5345f1c1ec59c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782239977.824486:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1782239977.824741:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec59b4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239977.824851:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec59b4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239977.824860:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec59b4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239977.824867:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5ee29ea00 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:2.0:1782239977.824872:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec59b4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239977.824880:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec59b4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239977.824895:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bb5c30e4000) 00010000:00010000:2.0:1782239977.824898:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782239977.824903:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec59b4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239977.824935:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec59b4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239977.824952:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e600/0x8c5345f1c1ec59bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239977.824959:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e600/0x8c5345f1c1ec59bb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239977.824965:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e600/0x8c5345f1c1ec59bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239977.824971:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5ee29e600 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:2.0:1782239977.824974:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e600/0x8c5345f1c1ec59bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239977.824981:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e600/0x8c5345f1c1ec59bb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239977.824989:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bb5c4ed6400) 00010000:00010000:2.0:1782239977.824992:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782239977.824995:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e600/0x8c5345f1c1ec59bb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239977.825001:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e600/0x8c5345f1c1ec59bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239977.825186:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e400/0x8c5345f1c1ec59ad lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e794 expref: 36 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239977.825271:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fe00/0x8c5345f1c1ec59c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e794 expref: 35 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239977.825346:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bb5c30e4a00) 00010000:00010000:2.0:1782239977.825349:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1782239977.825352:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5ee29fe00, rc 0) 00000100:00100000:2.0:1782239977.825527:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f77f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+35:11520:x1868813738003584:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 3151us (4962us total) trans 4294967477 rc 0/0 00000100:00100000:2.0:1782239977.825611:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 195 00000100:00100000:3.0:1782239977.832367:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239977.832668:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738003712 00000100:00100000:0.0:1782239977.832682:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738003712 00000100:00100000:0.0:1782239977.832806:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 196 00000100:00100000:0.0:1782239977.832819:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f77f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+35:11520:x1868813738003712:12345-192.168.203.32@tcp:54:lfs.0 00010000:00010000:0.0:1782239977.832921:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437800/0x8c5345f1c1ec59d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239977.832969:0:5792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27200/0x8c5345f1c1ec5975 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e77f expref: 35 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239977.832979:0:5792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437800/0x8c5345f1c1ec59d0 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239977.833025:0:5792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27200/0x8c5345f1c1ec5975 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e77f expref: 35 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239977.833042:0:5792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27200/0x8c5345f1c1ec5975 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e77f expref: 35 pid: 6611 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782239977.833348:0:5792:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f7812a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5792:1868813758969472:192.168.203.32@tcp:104: 00000100:00100000:0.0:1782239977.833566:0:5792:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5f7b47d80 going to sleep for 11 seconds 00000100:00100000:0.0:1782239977.835732:0:5792:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f7812a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5792:1868813758969472:192.168.203.32@tcp:104: 00010000:00010000:0.0:1782239977.835792:0:5792:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437800/0x8c5345f1c1ec59d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239977.836986:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239977.840096:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738003968 00000100:00100000:0.0:1782239977.840120:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738003968 00000100:00100000:0.0:1782239977.840233:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 52 00000100:00100000:0.0:1782239977.840246:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5dee25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+36:5564:x1868813738003968:12345-192.168.203.32@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1782239977.841276:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5dee25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+37:5564:x1868813738003968:12345-192.168.203.32@tcp:35:ldlm_bl.0 Request processed in 1020us (4284us total) trans 4294967478 rc 0/0 00000100:00100000:0.0:1782239977.841299:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 52 00000100:00100000:3.0:1782239977.850388:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239977.851765:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738004096 00000100:00100000:1.0:1782239977.851786:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738004096 00010000:00010000:1.0:1782239977.851854:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27200/0x8c5345f1c1ec5975 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e77f expref: 37 pid: 6611 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239977.852003:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 73 00000100:00100000:1.0:1782239977.852015:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5dee24380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+37:2345:x1868813738004096:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782239977.852048:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782239977.852057:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27200/0x8c5345f1c1ec5975 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e77f expref: 37 pid: 6611 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239977.852080:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27200/0x8c5345f1c1ec5975 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e77f expref: 37 pid: 6611 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239977.852110:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27200/0x8c5345f1c1ec5975 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e77f expref: 37 pid: 6611 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239977.852143:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bb5c30e4a00) 00010000:00010000:1.0:1782239977.852150:0:5777:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437800/0x8c5345f1c1ec59d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239977.852161:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437800/0x8c5345f1c1ec59d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239977.852170:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437800/0x8c5345f1c1ec59d0 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239977.852213:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782239977.852323:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5dee24380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+36:2345:x1868813738004096:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 308us (1949us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239977.852331:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 73 00010000:00010000:0.0:1782239977.852405:0:5792:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437800/0x8c5345f1c1ec59d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239977.852424:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437800/0x8c5345f1c1ec59d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239977.852469:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437800/0x8c5345f1c1ec59d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239977.852477:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437800/0x8c5345f1c1ec59d0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239977.852484:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437800/0x8c5345f1c1ec59d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239977.852490:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f4437800 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:0.0:1782239977.852496:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437800/0x8c5345f1c1ec59d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239977.852504:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437800/0x8c5345f1c1ec59d0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239977.852514:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bb5c30e4a00) 00010000:00010000:0.0:1782239977.852518:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782239977.852522:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437800/0x8c5345f1c1ec59d0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239977.852528:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437800/0x8c5345f1c1ec59d0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782239977.852587:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f77f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+35:11520:x1868813738003712:12345-192.168.203.32@tcp:54:lfs.0 Request processed in 19771us (20237us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239977.852596:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 196 00000100:00100000:2.0:1782239977.855479:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239977.855583:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738004352 00000100:00100000:0.0:1782239977.855595:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738004352 00000100:00100000:0.0:1782239977.855657:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 53 00000100:00100000:0.0:1782239977.855667:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+35:11520:x1868813738004352:12345-192.168.203.32@tcp:35:lfs.0 00000100:00100000:0.0:1782239977.856251:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+36:11520:x1868813738004352:12345-192.168.203.32@tcp:35:lfs.0 Request processed in 582us (785us total) trans 4294967479 rc 0/0 00000100:00100000:0.0:1782239977.856261:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 53 00000100:00100000:2.0:1782239977.972607:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239977.972774:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738004608 00000100:00100000:3.0:1782239977.972789:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738004608 00000100:00100000:3.0:1782239977.972867:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 197 00000100:00100000:3.0:1782239977.972879:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5eddf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+36:11531:x1868813738004608:12345-192.168.203.32@tcp:101:cat.0 00010000:00010000:3.0:1782239977.972921:0:6611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782239977.972949:0:6611:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26800/0x8c5345f1c1ec59d7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e79b expref: -99 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239977.973043:0:6611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27a00/0x8c5345f1c1ec59de lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239977.973061:0:6611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27a00/0x8c5345f1c1ec59de lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239977.973078:0:6611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27a00/0x8c5345f1c1ec59de lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239977.973095:0:6611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27c00/0x8c5345f1c1ec59e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239977.973103:0:6611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27c00/0x8c5345f1c1ec59e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239977.973134:0:6611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27c00/0x8c5345f1c1ec59e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239977.975363:0:6611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26c00/0x8c5345f1c1ec59ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239977.975393:0:6611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26c00/0x8c5345f1c1ec59ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239977.975409:0:6611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26c00/0x8c5345f1c1ec59ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782239977.975425:0:6611:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:3.0:1782239977.975582:0:6611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27a00/0x8c5345f1c1ec59de lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239977.975592:0:6611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27a00/0x8c5345f1c1ec59de lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239977.975600:0:6611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27a00/0x8c5345f1c1ec59de lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239977.975607:0:6611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f7e27a00 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:3.0:1782239977.975612:0:6611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27a00/0x8c5345f1c1ec59de lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239977.975621:0:6611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27a00/0x8c5345f1c1ec59de lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239977.975636:0:6611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bb5c30e4000) 00010000:00010000:3.0:1782239977.975639:0:6611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782239977.975660:0:6611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27a00/0x8c5345f1c1ec59de lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239977.975666:0:6611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27a00/0x8c5345f1c1ec59de lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239977.975684:0:6611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27c00/0x8c5345f1c1ec59e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239977.975690:0:6611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27c00/0x8c5345f1c1ec59e5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239977.977230:0:6611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27c00/0x8c5345f1c1ec59e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239977.977239:0:6611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f7e27c00 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:3.0:1782239977.977243:0:6611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27c00/0x8c5345f1c1ec59e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239977.977252:0:6611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27c00/0x8c5345f1c1ec59e5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239977.977270:0:6611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bb5d0df4100) 00010000:00010000:3.0:1782239977.977273:0:6611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782239977.977278:0:6611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27c00/0x8c5345f1c1ec59e5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239977.977284:0:6611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27c00/0x8c5345f1c1ec59e5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239977.977374:0:6611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26800/0x8c5345f1c1ec59d7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e79b expref: 39 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239977.977416:0:6611:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26c00/0x8c5345f1c1ec59ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e79b expref: 38 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239977.977424:0:6611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bb5c30e4a00) 00010000:00010000:3.0:1782239977.977427:0:6611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782239977.977430:0:6611:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5f7e26c00, rc 0) 00000100:00100000:3.0:1782239977.977521:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5eddf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+38:11531:x1868813738004608:12345-192.168.203.32@tcp:101:cat.0 Request processed in 4643us (4928us total) trans 4294967480 rc 0/0 00000100:00100000:3.0:1782239977.977532:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 197 00000100:00100000:3.0:1782239977.985162:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239977.985289:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738004864 00000100:00100000:0.0:1782239977.985304:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738004864 00000100:00100000:0.0:1782239977.985376:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 54 00000100:00100000:0.0:1782239977.985389:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7c0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+38:11531:x1868813738004864:12345-192.168.203.32@tcp:35:cat.0 00000100:00100000:0.0:1782239977.985742:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7c0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+39:11531:x1868813738004864:12345-192.168.203.32@tcp:35:cat.0 Request processed in 353us (592us total) trans 4294967481 rc 0/0 00000100:00100000:0.0:1782239977.985787:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 54 00000100:00100000:2.0:1782239978.017986:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239978.018282:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738005120 00000100:00100000:1.0:1782239978.018326:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738005120 00000100:00100000:1.0:1782239978.018420:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 198 00000100:00100000:1.0:1782239978.018433:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5c513c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+39:11532:x1868813738005120:12345-192.168.203.32@tcp:36:rm.0 00010000:00010000:1.0:1782239978.018520:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1782239978.018561:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26c00/0x8c5345f1c1ec59ec lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e79b expref: 39 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239978.018590:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fe00/0x8c5345f1c1ec59c2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e794 expref: 38 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1782239978.019005:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1782239978.019262:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27600/0x8c5345f1c1ec598a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e786 expref: 37 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239978.019284:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bb5c30e4a00) 00010000:00010000:1.0:1782239978.019298:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782239978.019327:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38800/0x8c5345f1c1ec59fa lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239978.019344:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38800/0x8c5345f1c1ec59fa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239978.019354:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38800/0x8c5345f1c1ec59fa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239978.019370:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38a00/0x8c5345f1c1ec5a01 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239978.019377:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38a00/0x8c5345f1c1ec5a01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239978.019401:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38a00/0x8c5345f1c1ec5a01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239978.020099:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39400/0x8c5345f1c1ec5a08 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239978.020212:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39400/0x8c5345f1c1ec5a08 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239978.020223:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39400/0x8c5345f1c1ec5a08 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782239978.025239:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:1.0:1782239978.025257:0:5791:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 357097508469ns, next at 358097504519ns, rc = 0 00010000:00010000:1.0:1782239978.025355:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38400/0x8c5345f1c1ec5a0f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239978.025379:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38400/0x8c5345f1c1ec5a0f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239978.025394:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38400/0x8c5345f1c1ec5a0f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239978.025405:0:5791:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38400/0x8c5345f1c1ec5a0f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239978.025412:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38400/0x8c5345f1c1ec5a0f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239978.025418:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38400/0x8c5345f1c1ec5a0f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239978.025466:0:5791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782239978.025502:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39400/0x8c5345f1c1ec5a08 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239978.025509:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39400/0x8c5345f1c1ec5a08 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239978.025516:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39400/0x8c5345f1c1ec5a08 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239978.025523:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f7e39400 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:1.0:1782239978.025529:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39400/0x8c5345f1c1ec5a08 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239978.025538:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39400/0x8c5345f1c1ec5a08 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239978.025554:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bb5c30e4200) 00010000:00010000:1.0:1782239978.025557:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1782239978.025563:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39400/0x8c5345f1c1ec5a08 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239978.025569:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39400/0x8c5345f1c1ec5a08 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239978.025591:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38800/0x8c5345f1c1ec59fa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239978.025598:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38800/0x8c5345f1c1ec59fa lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239978.025604:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38800/0x8c5345f1c1ec59fa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239978.025617:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f7e38800 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:1.0:1782239978.025620:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38800/0x8c5345f1c1ec59fa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239978.025626:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38800/0x8c5345f1c1ec59fa lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239978.025636:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bb5c30e4000) 00010000:00010000:1.0:1782239978.025638:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782239978.025642:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38800/0x8c5345f1c1ec59fa lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239978.025647:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38800/0x8c5345f1c1ec59fa lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782239978.025660:0:5791:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e859778d reply state 00000000fed61fa7 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38a00/0x8c5345f1c1ec5a01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239978.025672:0:5791:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1782239978.027061:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782239978.027078:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38400/0x8c5345f1c1ec5a0f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239978.027096:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f7e38400 already unused, calling callback (ffffffffc1728ce0) 00010000:00010000:3.0:1782239978.027100:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38400/0x8c5345f1c1ec5a0f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239978.027110:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38400/0x8c5345f1c1ec5a0f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239978.027135:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bb5c30e4200) 00010000:00010000:3.0:1782239978.027138:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782239978.027143:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38400/0x8c5345f1c1ec5a0f lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239978.027149:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38400/0x8c5345f1c1ec5a0f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239978.027203:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782239978.027205:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782239978.027207:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782239978.039323:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5c513c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+38:11532:x1868813738005120:12345-192.168.203.32@tcp:36:rm.0 Request processed in 20875us (21336us total) trans 4294967482 rc 0/0 00000100:00100000:1.0:1782239978.039340:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 198 00010000:00010000:0.0:1782239978.051656:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38a00/0x8c5345f1c1ec5a01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.051679:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38a00/0x8c5345f1c1ec5a01 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.051688:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38a00/0x8c5345f1c1ec5a01 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.051696:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f7e38a00 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:0.0:1782239978.051702:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38a00/0x8c5345f1c1ec5a01 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.051710:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38a00/0x8c5345f1c1ec5a01 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.051811:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bb5c30e4900) 00010000:00010000:0.0:1782239978.051815:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782239978.051822:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38a00/0x8c5345f1c1ec5a01 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.051830:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38a00/0x8c5345f1c1ec5a01 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239978.107077:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239978.107383:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738005376 00000100:00100000:3.0:1782239978.107395:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738005376 00000100:00100000:3.0:1782239978.107706:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 199 00000100:00100000:3.0:1782239978.107721:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5c513ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+37:11538:x1868813738005376:12345-192.168.203.32@tcp:101:bash.0 00010000:00010000:3.0:1782239978.107789:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782239978.107816:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26800/0x8c5345f1c1ec5a16 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e7a2 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239978.108011:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27c00/0x8c5345f1c1ec5a1d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239978.108030:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27c00/0x8c5345f1c1ec5a1d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239978.108043:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27c00/0x8c5345f1c1ec5a1d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239978.108060:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27a00/0x8c5345f1c1ec5a24 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239978.108067:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27a00/0x8c5345f1c1ec5a24 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239978.108073:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27a00/0x8c5345f1c1ec5a24 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782239978.109440:0:5790:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:3.0:1782239978.110103:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26a00/0x8c5345f1c1ec5a2b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239978.110136:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26a00/0x8c5345f1c1ec5a2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239978.110150:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26a00/0x8c5345f1c1ec5a2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239978.110470:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27c00/0x8c5345f1c1ec5a1d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239978.110479:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27c00/0x8c5345f1c1ec5a1d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239978.110487:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27c00/0x8c5345f1c1ec5a1d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239978.110494:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f7e27c00 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:3.0:1782239978.110499:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27c00/0x8c5345f1c1ec5a1d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239978.110518:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27c00/0x8c5345f1c1ec5a1d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239978.110535:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bb5c30e4000) 00010000:00010000:3.0:1782239978.110744:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782239978.110781:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27c00/0x8c5345f1c1ec5a1d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239978.110790:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27c00/0x8c5345f1c1ec5a1d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782239978.110827:0:5790:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e7bfcf9b reply state 00000000ddc2d7b8 transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27a00/0x8c5345f1c1ec5a24 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239978.110837:0:5790:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1782239978.110887:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26800/0x8c5345f1c1ec5a16 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e7a2 expref: 40 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239978.110977:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26a00/0x8c5345f1c1ec5a2b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e7a2 expref: 39 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239978.110986:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bb5d0df4900) 00010000:00010000:3.0:1782239978.110988:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782239978.110990:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5f7e26a00, rc 0) 00000100:00100000:3.0:1782239978.111181:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5c513ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+40:11538:x1868813738005376:12345-192.168.203.32@tcp:101:bash.0 Request processed in 3463us (4119us total) trans 4294967483 rc 0/0 00000100:00100000:3.0:1782239978.111201:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 199 00000100:00100000:2.0:1782239978.116906:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239978.117249:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738005504 00000100:00100000:1.0:1782239978.117261:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738005504 00000100:00100000:1.0:1782239978.117362:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 59 00000100:00100000:1.0:1782239978.117375:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5c513ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+5:2345:x1868813738005504:12345-192.168.203.32@tcp:101:bash.0 00010000:00010000:1.0:1782239978.117402:0:6590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782239978.117433:0:6590:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009d2d3776/0x8c5345f1c1ec5a39 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e7a9 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782239978.117492:0:6590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782239978.117535:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=357s v=(0 0) 00010000:00010000:1.0:1782239978.117540:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782239978.117553:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009d2d3776/0x8c5345f1c1ec5a39 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e7a9 expref: 6 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239978.117579:0:6590:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009d2d3776/0x8c5345f1c1ec5a39 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e7a9 expref: 6 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239978.117597:0:6590:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5f7e39400, rc 0) 00000100:00080000:2.0:1782239978.117697:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782239978.118334:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5c513ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+6:2345:x1868813738005504:12345-192.168.203.32@tcp:101:bash.0 Request processed in 958us (1440us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239978.118343:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 59 00010000:00010000:3.0:1782239978.118560:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27a00/0x8c5345f1c1ec5a24 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239978.118574:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27a00/0x8c5345f1c1ec5a24 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239978.118582:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27a00/0x8c5345f1c1ec5a24 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239978.118589:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f7e27a00 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:3.0:1782239978.118596:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27a00/0x8c5345f1c1ec5a24 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239978.118632:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27a00/0x8c5345f1c1ec5a24 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239978.118650:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bb5d0df4100) 00010000:00010000:3.0:1782239978.118654:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782239978.118659:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27a00/0x8c5345f1c1ec5a24 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239978.118666:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27a00/0x8c5345f1c1ec5a24 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239978.122151:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239978.122382:0:8312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738005632 00000100:00100000:0.0:1782239978.122396:0:8312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738005632 00000100:00100000:0.0:1782239978.122534:0:8312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 60 00000100:00100000:0.0:1782239978.122547:0:8312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7d0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+6:11538:x1868813738005632:12345-192.168.203.32@tcp:101:bash.0 00010000:00010000:0.0:1782239978.122574:0:8312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782239978.122608:0:8312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000048ace9aa/0x8c5345f1c1ec5a40 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e7b0 expref: -99 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.122650:0:8312:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009d2d3776/0x8c5345f1c1ec5a39 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e7a9 expref: 7 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.122660:0:8312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782239978.122665:0:8312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782239978.122671:0:8312:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048ace9aa/0x8c5345f1c1ec5a40 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e7b0 expref: 7 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.122716:0:8312:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009d2d3776/0x8c5345f1c1ec5a39 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e7a9 expref: 7 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.122788:0:8312:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009d2d3776/0x8c5345f1c1ec5a39 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e7a9 expref: 7 pid: 6590 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782239978.122807:0:8312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f7812a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8312:1868813758969600:192.168.203.32@tcp:104: 00000100:00100000:0.0:1782239978.122934:0:8312:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5f7b47480 going to sleep for 11 seconds 00000100:00100000:0.0:1782239978.125568:0:8312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f7812a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8312:1868813758969600:192.168.203.32@tcp:104: 00010000:00010000:0.0:1782239978.125615:0:8312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000048ace9aa/0x8c5345f1c1ec5a40 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e7b0 expref: 7 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.125642:0:8312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5f4437200, rc 0) 00000100:00100000:0.0:1782239978.125725:0:8312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7d0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+7:11538:x1868813738005632:12345-192.168.203.32@tcp:101:bash.0 Request processed in 3179us (3590us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239978.125736:0:8312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 60 00000100:00100000:0.0:1782239978.131222:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239978.131486:0:7481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738005760 00000100:00100000:3.0:1782239978.131500:0:7481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738005760 00010000:00010000:2.0:1782239978.131946:0:7481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009d2d3776/0x8c5345f1c1ec5a39 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e7a9 expref: 7 pid: 6590 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239978.132037:0:7481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 74 00000100:00100000:2.0:1782239978.132049:0:7481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7812a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+7:2344:x1868813738005760:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782239978.132072:0:7481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782239978.132103:0:7481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009d2d3776/0x8c5345f1c1ec5a39 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e7a9 expref: 7 pid: 6590 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239978.132119:0:7481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009d2d3776/0x8c5345f1c1ec5a39 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e7a9 expref: 7 pid: 6590 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239978.132171:0:7481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009d2d3776/0x8c5345f1c1ec5a39 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e7a9 expref: 7 pid: 6590 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239978.132258:0:7481:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782239978.132264:0:7481:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782239978.132274:0:7481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000048ace9aa/0x8c5345f1c1ec5a40 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e7b0 expref: 6 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239978.132349:0:7481:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048ace9aa/0x8c5345f1c1ec5a40 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e7b0 expref: 6 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239978.132426:0:7481:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000048ace9aa/0x8c5345f1c1ec5a40 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e7b0 expref: 6 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239978.132447:0:7481:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5c513d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7481:1868813758969728:192.168.203.32@tcp:105: 00000100:00100000:2.0:1782239978.133069:0:7481:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5e8e80300 going to sleep for 11 seconds 00000100:00100000:1.0:1782239978.139373:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239978.139456:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738006016 00000100:00100000:0.0:1782239978.139468:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738006016 00000100:00100000:0.0:1782239978.139535:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 55 00000100:00100000:0.0:1782239978.139548:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7d0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+39:11538:x1868813738006016:12345-192.168.203.32@tcp:35:bash.0 00000100:00100000:0.0:1782239978.140052:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7d0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+40:11538:x1868813738006016:12345-192.168.203.32@tcp:35:bash.0 Request processed in 505us (694us total) trans 4294967484 rc 0/0 00000100:00100000:0.0:1782239978.140061:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 55 00000100:00100000:2.0:1782239978.146423:0:7481:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5c513d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7481:1868813758969728:192.168.203.32@tcp:105: 00010000:00010000:2.0:1782239978.146466:0:7481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782239978.146561:0:7481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7812a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+6:2344:x1868813738005760:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 14512us (15352us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239978.146575:0:7481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 74 00000100:00100000:1.0:1782239978.316086:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239978.316220:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738006144 00000100:00100000:0.0:1782239978.316233:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738006144 00000100:00100000:0.0:1782239978.316333:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 200 00000100:00100000:0.0:1782239978.316345:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7d0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+40:11554:x1868813738006144:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:0.0:1782239978.316379:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782239978.316408:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437000/0x8c5345f1c1ec5a47 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e7b7 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.316497:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436c00/0x8c5345f1c1ec5a4e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.316515:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436c00/0x8c5345f1c1ec5a4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.316528:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436c00/0x8c5345f1c1ec5a4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782239978.316727:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:0.0:1782239978.316732:0:5792:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1782239978.316796:0:5792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436c00/0x8c5345f1c1ec5a4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.316826:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437000/0x8c5345f1c1ec5a47 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e7b7 expref: 42 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.316847:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436c00/0x8c5345f1c1ec5a4e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e7b7 expref: 41 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.316857:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bb5c30e4000) 00010000:00010000:0.0:1782239978.316860:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782239978.316864:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5f4436c00, rc 0) 00000100:00100000:0.0:1782239978.316994:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7d0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+41:11554:x1868813738006144:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 650us (920us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239978.317010:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 200 00000100:00100000:1.0:1782239978.325465:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239978.325696:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738006400 00000100:00100000:0.0:1782239978.325708:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738006400 00000100:00100000:0.0:1782239978.325809:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 201 00000100:00100000:0.0:1782239978.325821:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7d0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+41:11554:x1868813738006400:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:0.0:1782239978.325848:0:6611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782239978.325874:0:6611:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437000/0x8c5345f1c1ec5a55 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e7be expref: -99 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.326014:0:6611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437800/0x8c5345f1c1ec5a5c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.326031:0:6611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437800/0x8c5345f1c1ec5a5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.326045:0:6611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437800/0x8c5345f1c1ec5a5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782239978.326057:0:6611:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1782239978.326400:0:6611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437000/0x8c5345f1c1ec5a55 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e7be expref: 44 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.326424:0:6611:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437800/0x8c5345f1c1ec5a5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e7be expref: 43 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.326434:0:6611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bb5d0df4900) 00010000:00010000:0.0:1782239978.326437:0:6611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782239978.326442:0:6611:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5f4437800, rc 0) 00000100:00100000:0.0:1782239978.326606:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7d0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+43:11554:x1868813738006400:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 778us (1145us total) trans 4294967485 rc 0/0 00000100:00100000:0.0:1782239978.326615:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 201 00000100:00100000:0.0:1782239978.331702:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239978.331833:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239978.331901:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738006784 00000100:00100000:3.0:1782239978.331920:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738006784 00000100:00100000:3.0:1782239978.332001:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 14 00000100:00100000:3.0:1782239978.332014:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc299f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+43:2345:x1868813738006784:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782239978.332035:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782239978.332067:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437800/0x8c5345f1c1ec5a5c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e7be expref: 43 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239978.332090:0:5775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bb5d0df4900) 00010000:00010000:3.0:1782239978.332096:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782239978.332241:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc299f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+42:2345:x1868813738006784:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 229us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239978.332250:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 14 00000100:00100000:1.0:1782239978.332374:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738006656 00000100:00100000:1.0:1782239978.332379:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738006656 00000100:00100000:1.0:1782239978.332439:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 202 00000100:00100000:1.0:1782239978.332447:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7810700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+42:11554:x1868813738006656:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:1.0:1782239978.332471:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782239978.332487:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38e00/0x8c5345f1c1ec5a6a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e7c5 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239978.332636:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39600/0x8c5345f1c1ec5a71 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239978.332652:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39600/0x8c5345f1c1ec5a71 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239978.332663:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39600/0x8c5345f1c1ec5a71 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782239978.332675:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1782239978.332982:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38e00/0x8c5345f1c1ec5a6a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e7c5 expref: 45 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239978.332998:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39600/0x8c5345f1c1ec5a71 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e7c5 expref: 44 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239978.333006:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bb5d0df4900) 00010000:00010000:1.0:1782239978.333009:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1782239978.333013:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5f7e39600, rc 0) 00000100:00100000:1.0:1782239978.333047:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7810700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+44:11554:x1868813738006656:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 600us (1360us total) trans 4294967486 rc 0/0 00000100:00100000:1.0:1782239978.333054:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 202 00000100:00100000:3.0:1782239978.337465:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239978.337656:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738006912 00000100:00100000:2.0:1782239978.337670:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738006912 00000100:00100000:2.0:1782239978.337771:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 61 00000100:00100000:2.0:1782239978.337803:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f4532450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+6:2346:x1868813738006912:12345-192.168.203.32@tcp:1:lfs.0 00010000:00010000:2.0:1782239978.337866:0:6589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084a1df51/0x8c5345f1c1ec5a7f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239978.337889:0:6589:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000048ace9aa/0x8c5345f1c1ec5a40 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e7b0 expref: 6 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239978.337899:0:6589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782239978.337904:0:6589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782239978.337916:0:6589:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000084a1df51/0x8c5345f1c1ec5a7f lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239978.337963:0:6589:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000048ace9aa/0x8c5345f1c1ec5a40 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e7b0 expref: 6 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239978.337979:0:6589:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000048ace9aa/0x8c5345f1c1ec5a40 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e7b0 expref: 6 pid: 8312 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239978.337998:0:6589:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5c513d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6589:1868813758969856:192.168.203.32@tcp:104: 00000100:00100000:2.0:1782239978.338112:0:6589:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5e8e80300 going to sleep for 11 seconds 00000100:00100000:2.0:1782239978.342352:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239978.342439:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738007040 00000100:00100000:3.0:1782239978.342470:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738007040 00002000:00100000:3.0:1782239978.342534:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9bb5c513c380 x1868813738007040/t0(0) o4->36dd742b-25b8-431e-bf41-75f2fff47ffb@192.168.203.32@tcp:579/0 lens 504/0 e 0 to 0 dl 1782239989 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1782239978.342547:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9bb5c513c380 with x1868813738007040 ext(0->8) 00010000:00010000:3.0:1782239978.342557:0:6596:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000048ace9aa/0x8c5345f1c1ec5a40 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e7b0 expref: 7 pid: 8312 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239978.342577:0:6596:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000048ace9aa/0x8c5345f1c1ec5a40 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e7b0 expref: 7 pid: 8312 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782239978.342586:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9bb5c513c380 00000100:00100000:3.0:1782239978.342631:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 3 00000100:00100000:3.0:1782239978.342643:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5c513c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+7:2344:x1868813738007040:12345-192.168.203.32@tcp:4:lfs.0 00000100:00100000:3.0:1782239978.343281:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5c513c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+9:2344:x1868813738007040:12345-192.168.203.32@tcp:4:lfs.0 Request processed in 635us (939us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1782239978.343290:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 3 00002000:00100000:3.0:1782239978.343299:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9bb5c513c380 x1868813738007040/t4294967308(0) o4->36dd742b-25b8-431e-bf41-75f2fff47ffb@192.168.203.32@tcp:579/0 lens 504/448 e 0 to 0 dl 1782239989 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1782239978.343309:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9bb5c513c380 with x1868813738007040 ext(0->8) 00010000:00010000:3.0:1782239978.343316:0:6596:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000048ace9aa/0x8c5345f1c1ec5a40 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e7b0 expref: 9 pid: 8312 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239978.343330:0:6596:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000048ace9aa/0x8c5345f1c1ec5a40 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e7b0 expref: 9 pid: 8312 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782239978.343337:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9bb5c513c380 00000100:00100000:0.0:1782239978.344224:0:6589:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5c513d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6589:1868813758969856:192.168.203.32@tcp:104: 00010000:00010000:0.0:1782239978.344259:0:6589:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000084a1df51/0x8c5345f1c1ec5a7f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239978.351377:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239978.351535:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738007168 00000100:00100000:3.0:1782239978.351549:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738007168 00010000:00010000:3.0:1782239978.351614:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000048ace9aa/0x8c5345f1c1ec5a40 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e7b0 expref: 9 pid: 8312 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239978.351663:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 75 00000100:00100000:3.0:1782239978.351674:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d021a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+9:2346:x1868813738007168:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782239978.351693:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1782239978.351716:0:5776:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1782239978.351720:0:5776:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1782239978 00002000:00010000:3.0:1782239978.351722:0:5776:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1782239978 00002000:00010000:3.0:1782239978.351724:0:5776:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1782239978 00010000:00010000:3.0:1782239978.351731:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000048ace9aa/0x8c5345f1c1ec5a40 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e7b0 expref: 9 pid: 8312 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239978.351772:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000048ace9aa/0x8c5345f1c1ec5a40 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e7b0 expref: 9 pid: 8312 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239978.351804:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000048ace9aa/0x8c5345f1c1ec5a40 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e7b0 expref: 9 pid: 8312 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239978.351826:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782239978.351831:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782239978.351837:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000084a1df51/0x8c5345f1c1ec5a7f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239978.351848:0:5776:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000084a1df51/0x8c5345f1c1ec5a7f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239978.351901:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782239978.351988:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d021a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+8:2346:x1868813738007168:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 314us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239978.351997:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 75 00010000:00010000:0.0:1782239978.352730:0:6589:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000084a1df51/0x8c5345f1c1ec5a7f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.352744:0:6589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000084a1df51/0x8c5345f1c1ec5a7f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.352811:0:6589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084a1df51/0x8c5345f1c1ec5a7f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.352821:0:6589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000084a1df51/0x8c5345f1c1ec5a7f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.352830:0:6589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000084a1df51/0x8c5345f1c1ec5a7f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.352839:0:6589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5ee29e000 already unused, calling callback (ffffffffc1728ce0) 00010000:00010000:0.0:1782239978.352845:0:6589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000084a1df51/0x8c5345f1c1ec5a7f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.352869:0:6589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000084a1df51/0x8c5345f1c1ec5a7f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.352885:0:6589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000084a1df51/0x8c5345f1c1ec5a7f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.352893:0:6589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000084a1df51/0x8c5345f1c1ec5a7f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782239978.353005:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f4532450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+7:2346:x1868813738006912:12345-192.168.203.32@tcp:1:lfs.0 Request processed in 15202us (15551us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239978.353017:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 61 00000100:00100000:2.0:1782239978.359116:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239978.359206:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738007424 00000100:00100000:0.0:1782239978.359220:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738007424 00000100:00100000:0.0:1782239978.359295:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 56 00000100:00100000:0.0:1782239978.359306:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5c779dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+44:11554:x1868813738007424:12345-192.168.203.32@tcp:35:lfs.0 00000004:00010000:0.0:1782239978.359390:0:5794:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39600/0x8c5345f1c1ec5a71 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e7c5 expref: 44 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782239978.360054:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:0.0:1782239978.360105:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:0.0:1782239978.360518:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00010000:00010000:0.0:1782239978.361274:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437000/0x8c5345f1c1ec5a86 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.361355:0:5794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26a00/0x8c5345f1c1ec5a2b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e7a2 expref: 48 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.361382:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437000/0x8c5345f1c1ec5a86 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.361429:0:5794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26a00/0x8c5345f1c1ec5a2b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e7a2 expref: 48 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.361448:0:5794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26a00/0x8c5345f1c1ec5a2b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e7a2 expref: 48 pid: 5790 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782239978.361464:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fc298a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5794:1868813758969984:192.168.203.32@tcp:104: 00000100:00100000:0.0:1782239978.362173:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5f7b47c00 going to sleep for 11 seconds 00000100:00100000:0.0:1782239978.364276:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fc298a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5794:1868813758969984:192.168.203.32@tcp:104: 00010000:00010000:0.0:1782239978.364319:0:5794:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437000/0x8c5345f1c1ec5a86 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239978.369464:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239978.370598:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738007552 00000100:00100000:0.0:1782239978.370615:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738007552 00010000:00010000:0.0:1782239978.370675:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26a00/0x8c5345f1c1ec5a2b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e7a2 expref: 49 pid: 5790 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782239978.370724:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 76 00000100:00100000:0.0:1782239978.370735:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5c513ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+49:2345:x1868813738007552:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782239978.370802:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782239978.370811:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26a00/0x8c5345f1c1ec5a2b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e7a2 expref: 49 pid: 5790 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.370853:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26a00/0x8c5345f1c1ec5a2b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e7a2 expref: 49 pid: 5790 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.370882:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26a00/0x8c5345f1c1ec5a2b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e7a2 expref: 49 pid: 5790 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.370905:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bb5d0df4900) 00010000:00010000:0.0:1782239978.370924:0:5777:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437000/0x8c5345f1c1ec5a86 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.370935:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437000/0x8c5345f1c1ec5a86 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.370944:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437000/0x8c5345f1c1ec5a86 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.370986:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782239978.371063:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5c513ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+48:2345:x1868813738007552:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 328us (1613us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239978.371071:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 76 00010000:00010000:2.0:1782239978.371510:0:5794:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437000/0x8c5345f1c1ec5a86 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239978.371535:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437000/0x8c5345f1c1ec5a86 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782239978.371724:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000001:00080000:2.0:1782239978.372043:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:2.0:1782239978.372209:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5c513e680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5794:1868813758970112:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1782239978.372289:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239978.372338:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5e8e80240 going to sleep for 11 seconds 00000100:00100000:0.0:1782239978.372769:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758970112 00000100:00100000:0.0:1782239978.372786:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758970112 00000100:00100000:0.0:1782239978.372869:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1782239978.372880:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5c513ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5794:x1868813758970112:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1782239978.372986:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5c513ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5794:x1868813758970112:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 109us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239978.372994:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1782239978.373034:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782239978.373204:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5c513e680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5794:1868813758970112:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1782239978.373801:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:2.0:1782239978.373893:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5c513e680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5794:1868813758970240:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1782239978.373954:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239978.373985:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5e8e80d80 going to sleep for 11 seconds 00000100:00100000:0.0:1782239978.374204:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758970240 00000100:00100000:0.0:1782239978.374211:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758970240 00000100:00100000:0.0:1782239978.374248:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1782239978.374256:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5c513d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5794:x1868813758970240:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1782239978.374476:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5c513d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5794:x1868813758970240:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 220us (521us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1782239978.374485:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1782239978.374970:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5c513e680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5794:1868813758970240:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1782239978.375047:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:2.0:1782239978.375099:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437000/0x8c5345f1c1ec5a86 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239978.375113:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437000/0x8c5345f1c1ec5a86 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239978.375122:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437000/0x8c5345f1c1ec5a86 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239978.375129:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f4437000 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:2.0:1782239978.375135:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437000/0x8c5345f1c1ec5a86 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239978.375161:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437000/0x8c5345f1c1ec5a86 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239978.376377:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bb5d0df4900) 00010000:00010000:2.0:1782239978.376388:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1782239978.376396:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437000/0x8c5345f1c1ec5a86 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239978.376406:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437000/0x8c5345f1c1ec5a86 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782239978.376715:0:5794:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1782239978.377085:0:5794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:2.0:1782239978.377100:0:5794:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 357449350861ns, next at 358449348226ns, rc = 0 00000001:00080000:2.0:1782239978.377111:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:2.0:1782239978.377173:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bb5d0df4900) 00010000:00010000:2.0:1782239978.377234:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1782239978.377246:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39600/0x8c5345f1c1ec5a71 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e7c5 expref: 52 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239978.377462:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5c779dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+51:11554:x1868813738007424:12345-192.168.203.32@tcp:35:lfs.0 Request processed in 18155us (18355us total) trans 4294967495 rc 0/0 00000100:00100000:2.0:1782239978.377475:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 56 00000020:00080000:2.0:1782239978.377482:0:5794:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1782239978.380428:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239978.380665:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738007680 00000100:00100000:0.0:1782239978.380677:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738007680 00000100:00100000:0.0:1782239978.380855:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 203 00000100:00100000:0.0:1782239978.380867:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7c0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+51:11554:x1868813738007680:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:0.0:1782239978.380904:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782239978.380947:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436000/0x8c5345f1c1ec5a8d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e7cc expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.381034:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436000/0x8c5345f1c1ec5a8d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e7cc expref: 52 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.381053:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436000/0x8c5345f1c1ec5a8d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e7cc expref: 52 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.381077:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bb5c55de700) 00010000:00010000:0.0:1782239978.381080:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782239978.381084:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5f4436000, rc 0) 00000100:00100000:0.0:1782239978.381158:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7c0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+52:11554:x1868813738007680:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 293us (742us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239978.381167:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 203 00000100:00100000:1.0:1782239978.387426:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239978.387608:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738007936 00000100:00100000:3.0:1782239978.387621:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738007936 00000100:00100000:3.0:1782239978.387695:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 57 00000100:00100000:3.0:1782239978.387707:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7d0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+52:11554:x1868813738007936:12345-192.168.203.32@tcp:35:lfs.0 00000100:00100000:3.0:1782239978.388073:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7d0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+53:11554:x1868813738007936:12345-192.168.203.32@tcp:35:lfs.0 Request processed in 367us (663us total) trans 4294967496 rc 0/0 00000100:00100000:3.0:1782239978.388081:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 57 00000100:00100000:2.0:1782239978.481287:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239978.481455:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738008064 00000100:00100000:0.0:1782239978.481468:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738008064 00000100:00100000:0.0:1782239978.481553:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 204 00000100:00100000:0.0:1782239978.481564:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f779ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+53:11564:x1868813738008064:12345-192.168.203.32@tcp:34:lfs.0 00010000:00010000:0.0:1782239978.481670:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437e00/0x8c5345f1c1ec5a94 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.481693:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437e00/0x8c5345f1c1ec5a94 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.481707:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437e00/0x8c5345f1c1ec5a94 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.481725:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437400/0x8c5345f1c1ec5a9b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.481732:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437400/0x8c5345f1c1ec5a9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.481738:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437400/0x8c5345f1c1ec5a9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.481999:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436e00/0x8c5345f1c1ec5aa2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.482009:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436e00/0x8c5345f1c1ec5aa2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.482017:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436e00/0x8c5345f1c1ec5aa2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782239978.482082:0:5792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436e00/0x8c5345f1c1ec5aa2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.482121:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437e00/0x8c5345f1c1ec5a94 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.482128:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437e00/0x8c5345f1c1ec5a94 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.482136:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437e00/0x8c5345f1c1ec5a94 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.482143:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f4437e00 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:0.0:1782239978.482149:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437e00/0x8c5345f1c1ec5a94 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.482158:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437e00/0x8c5345f1c1ec5a94 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.482175:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bb5c30e4000) 00010000:00010000:0.0:1782239978.482178:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782239978.482184:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437e00/0x8c5345f1c1ec5a94 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.482191:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437e00/0x8c5345f1c1ec5a94 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.482207:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437400/0x8c5345f1c1ec5a9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.482214:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437400/0x8c5345f1c1ec5a9b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.482220:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437400/0x8c5345f1c1ec5a9b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.482236:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f4437400 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:0.0:1782239978.482239:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437400/0x8c5345f1c1ec5a9b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.482245:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437400/0x8c5345f1c1ec5a9b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.482253:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bb5c55ded00) 00010000:00010000:0.0:1782239978.482256:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782239978.482259:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437400/0x8c5345f1c1ec5a9b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.482266:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437400/0x8c5345f1c1ec5a9b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.483000:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436e00/0x8c5345f1c1ec5aa2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.483014:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436e00/0x8c5345f1c1ec5aa2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.483020:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436e00/0x8c5345f1c1ec5aa2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.483026:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f4436e00 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:0.0:1782239978.483029:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436e00/0x8c5345f1c1ec5aa2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.483036:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436e00/0x8c5345f1c1ec5aa2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.483058:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bb5c55de700) 00010000:00010000:0.0:1782239978.483060:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782239978.483064:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436e00/0x8c5345f1c1ec5aa2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.483070:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436e00/0x8c5345f1c1ec5aa2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782239978.484830:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f779ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+53:11564:x1868813738008064:12345-192.168.203.32@tcp:34:lfs.0 Request processed in 3251us (3547us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239978.484846:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 204 00000100:00100000:0.0:1782239978.527507:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239978.527779:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738008320 00000100:00100000:3.0:1782239978.527794:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738008320 00000100:00100000:3.0:1782239978.527875:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 205 00000100:00100000:3.0:1782239978.527888:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc298a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+53:11567:x1868813738008320:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:3.0:1782239978.527926:0:6611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782239978.527956:0:6611:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27a00/0x8c5345f1c1ec5aa9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e7d3 expref: -99 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239978.528054:0:6611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26800/0x8c5345f1c1ec5ab0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239978.528073:0:6611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26800/0x8c5345f1c1ec5ab0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239978.528108:0:6611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26800/0x8c5345f1c1ec5ab0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239978.528140:0:6611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27c00/0x8c5345f1c1ec5ab7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239978.528148:0:6611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27c00/0x8c5345f1c1ec5ab7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239978.528155:0:6611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27c00/0x8c5345f1c1ec5ab7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239978.528476:0:6611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26400/0x8c5345f1c1ec5abe lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239978.528486:0:6611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26400/0x8c5345f1c1ec5abe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239978.528493:0:6611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26400/0x8c5345f1c1ec5abe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782239978.528505:0:6611:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1782239978.529557:0:6611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26800/0x8c5345f1c1ec5ab0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239978.529573:0:6611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26800/0x8c5345f1c1ec5ab0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239978.529581:0:6611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26800/0x8c5345f1c1ec5ab0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239978.529587:0:6611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f7e26800 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:3.0:1782239978.529828:0:6611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26800/0x8c5345f1c1ec5ab0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239978.529839:0:6611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26800/0x8c5345f1c1ec5ab0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239978.529858:0:6611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bb5c30e4000) 00010000:00010000:3.0:1782239978.529862:0:6611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782239978.529867:0:6611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26800/0x8c5345f1c1ec5ab0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239978.529875:0:6611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26800/0x8c5345f1c1ec5ab0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239978.529894:0:6611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27c00/0x8c5345f1c1ec5ab7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239978.529900:0:6611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27c00/0x8c5345f1c1ec5ab7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239978.529906:0:6611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27c00/0x8c5345f1c1ec5ab7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239978.529921:0:6611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f7e27c00 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:3.0:1782239978.529925:0:6611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27c00/0x8c5345f1c1ec5ab7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239978.529931:0:6611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27c00/0x8c5345f1c1ec5ab7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239978.529939:0:6611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bb5d0df4100) 00010000:00010000:3.0:1782239978.529942:0:6611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782239978.529955:0:6611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27c00/0x8c5345f1c1ec5ab7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239978.529962:0:6611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27c00/0x8c5345f1c1ec5ab7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239978.530038:0:6611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27a00/0x8c5345f1c1ec5aa9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e7d3 expref: 56 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239978.530058:0:6611:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26400/0x8c5345f1c1ec5abe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e7d3 expref: 55 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239978.530067:0:6611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bb5c55de700) 00010000:00010000:3.0:1782239978.530069:0:6611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782239978.530072:0:6611:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5f7e26400, rc 0) 00000100:00100000:2.0:1782239978.531244:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc298a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+55:11567:x1868813738008320:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 3347us (3743us total) trans 4294967497 rc 0/0 00000100:00100000:2.0:1782239978.531258:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 205 00000100:00100000:1.0:1782239978.535437:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239978.535675:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738008448 00000100:00100000:2.0:1782239978.535688:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738008448 00000100:00100000:0.0:1782239978.535920:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 206 00000100:00100000:0.0:1782239978.535935:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7d0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+55:11567:x1868813738008448:12345-192.168.203.32@tcp:54:lfs.0 00010000:00010000:0.0:1782239978.536031:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437400/0x8c5345f1c1ec5acc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.536054:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437400/0x8c5345f1c1ec5acc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.536070:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437400/0x8c5345f1c1ec5acc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.536105:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437400/0x8c5345f1c1ec5acc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.536113:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437400/0x8c5345f1c1ec5acc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.536120:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437400/0x8c5345f1c1ec5acc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.536416:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f4437400 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:0.0:1782239978.536422:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437400/0x8c5345f1c1ec5acc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.536431:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437400/0x8c5345f1c1ec5acc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.536447:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bb5c55de700) 00010000:00010000:0.0:1782239978.536450:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782239978.536456:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437400/0x8c5345f1c1ec5acc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.536464:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437400/0x8c5345f1c1ec5acc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782239978.536863:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7d0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+55:11567:x1868813738008448:12345-192.168.203.32@tcp:54:lfs.0 Request processed in 927us (1436us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239978.536872:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 206 00000100:00100000:3.0:1782239978.541115:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239978.541494:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738008704 00000100:00100000:1.0:1782239978.541507:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738008704 00000100:00100000:1.0:1782239978.541582:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 58 00000100:00100000:1.0:1782239978.541592:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7c0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+55:11567:x1868813738008704:12345-192.168.203.32@tcp:35:lfs.0 00000100:00100000:1.0:1782239978.541967:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7c0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+56:11567:x1868813738008704:12345-192.168.203.32@tcp:35:lfs.0 Request processed in 374us (865us total) trans 4294967498 rc 0/0 00000100:00100000:1.0:1782239978.541976:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 58 00000100:00100000:0.0:1782239978.635929:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239978.636049:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738008960 00000100:00100000:3.0:1782239978.636063:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738008960 00000100:00100000:3.0:1782239978.636138:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 207 00000100:00100000:3.0:1782239978.636159:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc299180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+56:11577:x1868813738008960:12345-192.168.203.32@tcp:101:bash.0 00010000:00010000:3.0:1782239978.636192:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782239978.636196:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1782239978.636232:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436c00/0x8c5345f1c1ec5a4e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e7b7 expref: 56 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239978.636257:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bb5c30e4000) 00010000:00010000:3.0:1782239978.636264:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782239978.636281:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27a00/0x8c5345f1c1ec5ad3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e7da expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239978.636435:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27c00/0x8c5345f1c1ec5ada lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239978.636451:0:5790:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26400/0x8c5345f1c1ec5abe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e7d3 expref: 56 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239978.636461:0:5790:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27c00/0x8c5345f1c1ec5ada lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239978.636517:0:5790:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26400/0x8c5345f1c1ec5abe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e7d3 expref: 56 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239978.636532:0:5790:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26400/0x8c5345f1c1ec5abe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e7d3 expref: 56 pid: 6611 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239978.636547:0:5790:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f48eca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5790:1868813758970368:192.168.203.32@tcp:104: 00000100:00100000:3.0:1782239978.636670:0:5790:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c7f79540 going to sleep for 11 seconds 00000100:00100000:3.0:1782239978.644682:0:5790:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f48eca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5790:1868813758970368:192.168.203.32@tcp:104: 00010000:00010000:3.0:1782239978.644721:0:5790:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27c00/0x8c5345f1c1ec5ada lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782239978.650273:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239978.652072:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738009088 00000100:00100000:3.0:1782239978.652092:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738009088 00010000:00010000:3.0:1782239978.653010:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26400/0x8c5345f1c1ec5abe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e7d3 expref: 57 pid: 6611 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239978.653278:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 77 00000100:00100000:3.0:1782239978.653312:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc298700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+57:2344:x1868813738009088:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782239978.653333:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782239978.653352:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26400/0x8c5345f1c1ec5abe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e7d3 expref: 57 pid: 6611 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239978.653369:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26400/0x8c5345f1c1ec5abe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e7d3 expref: 57 pid: 6611 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239978.653400:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26400/0x8c5345f1c1ec5abe lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e7d3 expref: 57 pid: 6611 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239978.653423:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bb5c55de700) 00010000:00010000:3.0:1782239978.653429:0:5776:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27c00/0x8c5345f1c1ec5ada lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239978.653440:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27c00/0x8c5345f1c1ec5ada lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239978.653449:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27c00/0x8c5345f1c1ec5ada lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239978.653488:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782239978.653570:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc298700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+56:2344:x1868813738009088:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 261us (3311us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239978.653580:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 77 00010000:00010000:0.0:1782239978.653645:0:5790:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27c00/0x8c5345f1c1ec5ada lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.653655:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27c00/0x8c5345f1c1ec5ada lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782239978.653681:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1782239978.663195:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27a00/0x8c5345f1c1ec5ad3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e7da expref: 57 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.663258:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27c00/0x8c5345f1c1ec5ada lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e7da expref: 56 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.663270:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bb5c55de700) 00010000:00010000:0.0:1782239978.663273:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1782239978.663276:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5f7e27c00, rc 0) 00000100:00100000:0.0:1782239978.663371:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc299180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+56:11577:x1868813738008960:12345-192.168.203.32@tcp:101:bash.0 Request processed in 27222us (27466us total) trans 4294967499 rc 0/0 00000100:00100000:0.0:1782239978.663381:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 207 00000100:00100000:0.0:1782239978.677003:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239978.677058:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738009344 00000100:00100000:2.0:1782239978.677071:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738009344 00000100:00100000:0.0:1782239978.677138:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 208 00000100:00100000:0.0:1782239978.677150:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc298e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+56:11577:x1868813738009344:12345-192.168.203.32@tcp:36:bash.0 00010000:00010000:0.0:1782239978.677513:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436800/0x8c5345f1c1ec5ae8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.677535:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436800/0x8c5345f1c1ec5ae8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.677549:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436800/0x8c5345f1c1ec5ae8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782239978.677727:0:5792:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967500 00000004:00010000:0.0:1782239978.677801:0:5792:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f4137874 reply state 000000003eb2f26d transno 4294967501 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436800/0x8c5345f1c1ec5ae8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782239978.677813:0:5792:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782239978.677926:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc298e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+59:11577:x1868813738009344:12345-192.168.203.32@tcp:36:bash.0 Request processed in 776us (935us total) trans 4294967501 rc 0/0 00000100:00100000:0.0:1782239978.677952:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 208 00000020:00080000:0.0:1782239978.677959:0:5792:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1782239978.680570:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436800/0x8c5345f1c1ec5ae8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.680592:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436800/0x8c5345f1c1ec5ae8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.680600:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436800/0x8c5345f1c1ec5ae8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.680607:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f4436800 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:0.0:1782239978.680612:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436800/0x8c5345f1c1ec5ae8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.680621:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436800/0x8c5345f1c1ec5ae8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.680643:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bb5c55de700) 00010000:00010000:0.0:1782239978.680647:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782239978.680652:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436800/0x8c5345f1c1ec5ae8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.680658:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436800/0x8c5345f1c1ec5ae8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782239978.686518:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239978.686779:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738009472 00000100:00100000:2.0:1782239978.686793:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738009472 00000100:00100000:2.0:1782239978.686865:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 209 00000100:00100000:2.0:1782239978.686887:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc29bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+58:11577:x1868813738009472:12345-192.168.203.32@tcp:101:bash.0 00010000:00010000:2.0:1782239978.686926:0:6611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782239978.686953:0:6611:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e800/0x8c5345f1c1ec5aef lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e7e1 expref: -99 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239978.687063:0:6611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fe00/0x8c5345f1c1ec5af6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239978.687082:0:6611:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27c00/0x8c5345f1c1ec5ada lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e7da expref: 59 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239978.687093:0:6611:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fe00/0x8c5345f1c1ec5af6 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239978.687477:0:6611:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27c00/0x8c5345f1c1ec5ada lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e7da expref: 59 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239978.687494:0:6611:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27c00/0x8c5345f1c1ec5ada lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e7da expref: 59 pid: 5790 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239978.687510:0:6611:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f48c2300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6611:1868813758970496:192.168.203.32@tcp:104: 00000100:00100000:2.0:1782239978.687718:0:6611:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5e8e80840 going to sleep for 11 seconds 00000100:00100000:1.0:1782239978.703474:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239978.703592:0:6611:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f48c2300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6611:1868813758970496:192.168.203.32@tcp:104: 00010000:00010000:2.0:1782239978.703628:0:6611:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fe00/0x8c5345f1c1ec5af6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782239978.703707:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738009600 00000100:00100000:0.0:1782239978.703716:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738009600 00010000:00010000:0.0:1782239978.703813:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27c00/0x8c5345f1c1ec5ada lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e7da expref: 60 pid: 5790 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782239978.703880:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 78 00000100:00100000:0.0:1782239978.703891:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7d0e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+60:2345:x1868813738009600:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782239978.703922:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782239978.703930:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27c00/0x8c5345f1c1ec5ada lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e7da expref: 60 pid: 5790 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.703943:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27c00/0x8c5345f1c1ec5ada lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e7da expref: 60 pid: 5790 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.703971:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27c00/0x8c5345f1c1ec5ada lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e7da expref: 60 pid: 5790 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.703988:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bb5c55de700) 00010000:00010000:0.0:1782239978.703994:0:5777:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fe00/0x8c5345f1c1ec5af6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.704005:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fe00/0x8c5345f1c1ec5af6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.704013:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fe00/0x8c5345f1c1ec5af6 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.704042:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782239978.704107:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7d0e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+59:2345:x1868813738009600:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 217us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239978.704115:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 78 00010000:00010000:2.0:1782239978.704320:0:6611:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fe00/0x8c5345f1c1ec5af6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239978.704328:0:6611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fe00/0x8c5345f1c1ec5af6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782239978.704392:0:6611:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1782239978.704397:0:6611:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782239978.704422:0:6611:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fe00/0x8c5345f1c1ec5af6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239978.704459:0:6611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e800/0x8c5345f1c1ec5aef lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e7e1 expref: 60 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239978.704477:0:6611:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fe00/0x8c5345f1c1ec5af6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e7e1 expref: 59 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239978.704485:0:6611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bb5c55de700) 00010000:00010000:2.0:1782239978.704488:0:6611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782239978.704491:0:6611:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5ee29fe00, rc 0) 00000100:00100000:2.0:1782239978.704520:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc29bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+59:11577:x1868813738009472:12345-192.168.203.32@tcp:101:bash.0 Request processed in 17646us (18017us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239978.704527:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 209 00000100:00100000:1.0:1782239978.712743:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239978.713601:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738009856 00000100:00100000:3.0:1782239978.713615:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738009856 00000100:00100000:3.0:1782239978.713692:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 59 00000100:00100000:3.0:1782239978.713705:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7d0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+58:11577:x1868813738009856:12345-192.168.203.32@tcp:35:bash.0 00000100:00100000:3.0:1782239978.714078:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7d0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+59:11577:x1868813738009856:12345-192.168.203.32@tcp:35:bash.0 Request processed in 374us (1349us total) trans 4294967502 rc 0/0 00000100:00100000:3.0:1782239978.714087:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 59 00010000:00010000:2.0:1782239978.718919:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782239978.783210:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f48c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1868813758970624:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782239978.783309:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239978.783453:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758970624 00000100:00100000:2.0:1782239978.783464:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758970624 00000100:00100000:2.0:1782239978.783544:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1782239978.783556:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1868813758970624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782239978.783588:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:2.0:1782239978.783655:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1868813758970624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239978.783664:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1782239978.785008:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f48c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1868813758970624:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782239978.816331:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239978.818606:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738009984 00000100:00100000:2.0:1782239978.818626:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738009984 00000100:00100000:2.0:1782239978.818729:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 210 00000100:00100000:2.0:1782239978.818741:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7d0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+59:11583:x1868813738009984:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:2.0:1782239978.818788:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782239978.818816:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e800/0x8c5345f1c1ec5afd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e7e8 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239978.819017:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec5b04 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239978.819036:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec5b04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239978.819049:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec5b04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782239978.819132:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:2.0:1782239978.819137:0:5791:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1782239978.819164:0:5791:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec5b04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239978.819195:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e800/0x8c5345f1c1ec5afd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e7e8 expref: 61 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239978.819242:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec5b04 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e7e8 expref: 60 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239978.819252:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bb5c30e4000) 00010000:00010000:2.0:1782239978.819255:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782239978.819259:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5ee29ea00, rc 0) 00000100:00100000:2.0:1782239978.820323:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7d0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+60:11583:x1868813738009984:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 1576us (3998us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239978.820335:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 210 00000100:00100000:1.0:1782239978.840308:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239978.842012:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738010112 00000100:00100000:0.0:1782239978.842057:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738010112 00000100:00100000:0.0:1782239978.842151:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 211 00000100:00100000:0.0:1782239978.842164:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7d0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+60:11583:x1868813738010112:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:0.0:1782239978.842194:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782239978.842223:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436800/0x8c5345f1c1ec5b0b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e7ef expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.842312:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437c00/0x8c5345f1c1ec5b12 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.842331:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437c00/0x8c5345f1c1ec5b12 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.842345:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437c00/0x8c5345f1c1ec5b12 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.842363:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436a00/0x8c5345f1c1ec5b19 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.842371:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436a00/0x8c5345f1c1ec5b19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.842377:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436a00/0x8c5345f1c1ec5b19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.842835:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437600/0x8c5345f1c1ec5b20 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.842847:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437600/0x8c5345f1c1ec5b20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.842855:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437600/0x8c5345f1c1ec5b20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782239978.842927:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1782239978.842932:0:5790:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782239978.842955:0:5790:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437600/0x8c5345f1c1ec5b20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.842970:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437600/0x8c5345f1c1ec5b20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.842979:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437c00/0x8c5345f1c1ec5b12 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.842985:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437c00/0x8c5345f1c1ec5b12 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.842991:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437c00/0x8c5345f1c1ec5b12 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.842997:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f4437c00 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:0.0:1782239978.843002:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437c00/0x8c5345f1c1ec5b12 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.843009:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437c00/0x8c5345f1c1ec5b12 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.843023:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bb5c30e4000) 00010000:00010000:0.0:1782239978.843026:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782239978.843032:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437c00/0x8c5345f1c1ec5b12 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.843038:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437c00/0x8c5345f1c1ec5b12 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.843064:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436a00/0x8c5345f1c1ec5b19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.843070:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436a00/0x8c5345f1c1ec5b19 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.843076:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436a00/0x8c5345f1c1ec5b19 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.843082:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f4436a00 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:0.0:1782239978.843086:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436a00/0x8c5345f1c1ec5b19 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.843092:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436a00/0x8c5345f1c1ec5b19 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.843100:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bb5c55ded00) 00010000:00010000:0.0:1782239978.843102:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782239978.843106:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436a00/0x8c5345f1c1ec5b19 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.843112:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436a00/0x8c5345f1c1ec5b19 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.843151:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436800/0x8c5345f1c1ec5b0b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e7ef expref: 62 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.843167:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437600/0x8c5345f1c1ec5b20 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e7ef expref: 61 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.843187:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bb5c55de700) 00010000:00010000:0.0:1782239978.843189:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782239978.843192:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5f4437600, rc 0) 00000100:00100000:0.0:1782239978.843360:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7d0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+61:11583:x1868813738010112:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 1197us (3068us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239978.843370:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 211 00000100:00100000:1.0:1782239978.857323:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239978.857392:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239978.857546:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738010496 00000100:00100000:0.0:1782239978.857560:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738010496 00000100:00100000:0.0:1782239978.857640:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 212 00000100:00100000:0.0:1782239978.857652:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7d0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+61:11583:x1868813738010496:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:0.0:1782239978.857684:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782239978.857710:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436800/0x8c5345f1c1ec5b27 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e7f6 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.857896:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436a00/0x8c5345f1c1ec5b2e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.857924:0:5792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fe00/0x8c5345f1c1ec5af6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e7e1 expref: 62 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.857933:0:5792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437600/0x8c5345f1c1ec5b20 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e7ef expref: 62 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.857942:0:5792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436a00/0x8c5345f1c1ec5b2e lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.857986:0:5792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437600/0x8c5345f1c1ec5b20 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e7ef expref: 62 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.858022:0:5792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437600/0x8c5345f1c1ec5b20 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e7ef expref: 62 pid: 5790 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782239978.858040:0:5792:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fc298000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5792:1868813758970752:192.168.203.32@tcp:104: 00010000:00010000:0.0:1782239978.858175:0:5792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fe00/0x8c5345f1c1ec5af6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e7e1 expref: 62 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239978.858186:0:5792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fe00/0x8c5345f1c1ec5af6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e7e1 expref: 62 pid: 6611 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782239978.858197:0:5792:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fc299f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5792:1868813758970880:192.168.203.32@tcp:104: 00000100:00100000:0.0:1782239978.858224:0:5792:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5f7b47c00 going to sleep for 11 seconds 00000100:00100000:2.0:1782239978.858298:0:7481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738010240 00000100:00100000:2.0:1782239978.858304:0:7481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738010240 00010000:00010000:2.0:1782239978.858332:0:7481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437600/0x8c5345f1c1ec5b20 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e7ef expref: 63 pid: 5790 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239978.858370:0:7481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 79 00000100:00100000:2.0:1782239978.858378:0:7481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7d0f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+63:2345:x1868813738010240:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782239978.858390:0:7481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782239978.858397:0:7481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437600/0x8c5345f1c1ec5b20 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e7ef expref: 63 pid: 5790 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239978.858409:0:7481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437600/0x8c5345f1c1ec5b20 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e7ef expref: 63 pid: 5790 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239978.858439:0:7481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bb5c55de700) 00010000:00010000:2.0:1782239978.858443:0:7481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436a00/0x8c5345f1c1ec5b2e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239978.858460:0:7481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436a00/0x8c5345f1c1ec5b2e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239978.858467:0:7481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782239978.858495:0:7481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7d0f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+63:2345:x1868813738010240:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 118us (1190us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239978.858504:0:7481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 79 00000100:00100000:1.0:1782239978.864734:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00010000:00010000:2.0:1782239978.865072:0:5792:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.32@tcp) returned -22 from blocking AST (req@00000000d13bbae1 x1868813758970752) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437600/0x8c5345f1c1ec5b20 lrc: 1/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e7ef expref: 62 pid: 5790 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239978.865101:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437600/0x8c5345f1c1ec5b20 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e7ef expref: 62 pid: 5790 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239978.865121:0:5792:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fc298000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5792:1868813758970752:192.168.203.32@tcp:104: 00000100:00100000:2.0:1782239978.865149:0:5792:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fc299f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5792:1868813758970880:192.168.203.32@tcp:104: 00010000:00010000:2.0:1782239978.865183:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bb5c55de700) 00010000:00010000:2.0:1782239978.865190:0:5792:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436a00/0x8c5345f1c1ec5b2e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239978.865200:0:5792:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436a00/0x8c5345f1c1ec5b2e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239978.865211:0:5792:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436a00/0x8c5345f1c1ec5b2e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239978.866916:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738010624 00000100:00100000:3.0:1782239978.866936:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738010624 00010000:00010000:3.0:1782239978.866998:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fe00/0x8c5345f1c1ec5af6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e7e1 expref: 62 pid: 6611 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239978.867049:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 80 00000100:00100000:3.0:1782239978.867060:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7d0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+62:2344:x1868813738010624:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782239978.867080:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782239978.867086:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fe00/0x8c5345f1c1ec5af6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e7e1 expref: 62 pid: 6611 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239978.867101:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fe00/0x8c5345f1c1ec5af6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e7e1 expref: 62 pid: 6611 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239978.867139:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fe00/0x8c5345f1c1ec5af6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e7e1 expref: 62 pid: 6611 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239978.867161:0:5775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bb5c55de700) 00010000:00010000:3.0:1782239978.867166:0:5775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436a00/0x8c5345f1c1ec5b2e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239978.867205:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436a00/0x8c5345f1c1ec5b2e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239978.867215:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436a00/0x8c5345f1c1ec5b2e lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239978.867246:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782239978.867841:0:5792:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436a00/0x8c5345f1c1ec5b2e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239978.867859:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436a00/0x8c5345f1c1ec5b2e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782239978.867886:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1782239978.868111:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436800/0x8c5345f1c1ec5b27 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e7f6 expref: 63 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239978.868143:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436a00/0x8c5345f1c1ec5b2e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e7f6 expref: 62 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239978.868152:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bb5c55de700) 00010000:00010000:2.0:1782239978.868155:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1782239978.868158:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5f4436a00, rc 0) 00000100:00100000:3.0:1782239978.868256:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7d0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+62:2344:x1868813738010624:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 1196us (3535us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239978.868268:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 80 00000100:00100000:2.0:1782239978.872074:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7d0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+61:11583:x1868813738010496:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 14405us (14663us total) trans 4294967503 rc 0/0 00000100:00100000:2.0:1782239978.872091:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 212 00000100:00100000:0.0:1782239978.887443:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239978.887532:0:7481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738010880 00000100:00100000:2.0:1782239978.887546:0:7481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738010880 00000100:00100000:2.0:1782239978.887631:0:7481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 15 00000100:00100000:2.0:1782239978.887644:0:7481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc299f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+61:11583:x1868813738010880:12345-192.168.203.32@tcp:103:lfs.0 00010000:00010000:2.0:1782239978.887666:0:7481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782239978.887699:0:7481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436000/0x8c5345f1c1ec5a8d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e7cc expref: 61 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239978.887724:0:7481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bb5c55de700) 00010000:00010000:2.0:1782239978.887730:0:7481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782239978.888017:0:7481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc299f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+60:11583:x1868813738010880:12345-192.168.203.32@tcp:103:lfs.0 Request processed in 375us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239978.888027:0:7481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 15 00000100:00100000:0.0:1782239978.891056:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239978.891170:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738011008 00000100:00100000:2.0:1782239978.891193:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738011008 00000100:00100000:2.0:1782239978.891264:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 213 00000100:00100000:2.0:1782239978.891276:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc298000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+60:11583:x1868813738011008:12345-192.168.203.32@tcp:58:lfs.0 00010000:00010000:2.0:1782239978.891653:0:6611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e800/0x8c5345f1c1ec5b3c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239978.891676:0:6611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e800/0x8c5345f1c1ec5b3c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239978.891690:0:6611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e800/0x8c5345f1c1ec5b3c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782239978.892734:0:6611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1782239978.899102:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc298000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+60:11583:x1868813738011008:12345-192.168.203.32@tcp:58:lfs.0 Request processed in 7807us (8038us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239978.899125:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 213 00000100:00100000:1.0:1782239978.914150:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239978.914440:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738011136 00000100:00100000:2.0:1782239978.914455:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738011136 00000100:00100000:2.0:1782239978.914549:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 214 00000100:00100000:2.0:1782239978.914563:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7d0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+60:11583:x1868813738011136:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:2.0:1782239978.914592:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782239978.914624:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e600/0x8c5345f1c1ec5b43 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e7fd expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239978.914710:0:5791:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e800/0x8c5345f1c1ec5b3c lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239978.914738:0:5791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e600/0x8c5345f1c1ec5b43 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e7fd expref: 61 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239978.914815:0:5791:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e800/0x8c5345f1c1ec5b3c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239978.914836:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e600/0x8c5345f1c1ec5b43 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e7fd expref: 61 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239978.914853:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bb5c55de700) 00010000:00010000:2.0:1782239978.914857:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782239978.914861:0:5791:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e600/0x8c5345f1c1ec5b43 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e7fd expref: 61 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239978.914870:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5ee29e600, rc 0) 00000100:00100000:2.0:1782239978.914966:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7d0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+61:11583:x1868813738011136:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 405us (845us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239978.914975:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 214 00000040:00080000:3.0:1782239979.359797:0:11535:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782239979.359812:0:11535:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1782239979.359859:0:11535:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:3.0:1782239979.359881:0:11535:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1782239979.360062:0:11535:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f48ee300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11535:1868813758971008:192.168.203.32@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1782239979.360668:0:11535:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c7f79b40 going to sleep for 11 seconds 00000100:00100000:1.0:1782239979.366699:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239979.367339:0:11535:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f48ee300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11535:1868813758971008:192.168.203.32@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1782239979.367613:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738011264 00000100:00100000:0.0:1782239979.367622:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738011264 00000100:00100000:0.0:1782239979.367691:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 215 00000100:00100000:0.0:1782239979.367702:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7d0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+61:11584:x1868813738011264:12345-192.168.203.32@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1782239979.368119:0:5790:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1782239979.368521:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7d0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+61:11584:x1868813738011264:12345-192.168.203.32@tcp:53:lhsmtool_posix.0 Request processed in 818us (1834us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239979.368530:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 215 00000100:00100000:3.0:1782239979.372503:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239979.372849:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738011392 00000100:00100000:2.0:1782239979.372864:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738011392 00000100:00100000:2.0:1782239979.372959:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 216 00000100:00100000:2.0:1782239979.372972:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+61:11584:x1868813738011392:12345-192.168.203.32@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1782239979.373070:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e400/0x8c5345f1c1ec5b4a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239979.373091:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e400/0x8c5345f1c1ec5b4a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239979.373131:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e400/0x8c5345f1c1ec5b4a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239979.373153:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fc00/0x8c5345f1c1ec5b51 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239979.373160:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fc00/0x8c5345f1c1ec5b51 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239979.373167:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fc00/0x8c5345f1c1ec5b51 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239979.373213:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e200/0x8c5345f1c1ec5b58 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239979.373223:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e200/0x8c5345f1c1ec5b58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239979.373229:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e200/0x8c5345f1c1ec5b58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782239979.373288:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1782239979.373294:0:5791:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782239979.373308:0:5791:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e200/0x8c5345f1c1ec5b58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239979.373320:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e400/0x8c5345f1c1ec5b4a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239979.373327:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e400/0x8c5345f1c1ec5b4a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239979.373345:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e400/0x8c5345f1c1ec5b4a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239979.373352:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5ee29e400 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:2.0:1782239979.373357:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e400/0x8c5345f1c1ec5b4a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239979.373369:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e400/0x8c5345f1c1ec5b4a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239979.373382:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bb5d0df4b00) 00010000:00010000:2.0:1782239979.373386:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782239979.373391:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e400/0x8c5345f1c1ec5b4a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239979.373397:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e400/0x8c5345f1c1ec5b4a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239979.373412:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fc00/0x8c5345f1c1ec5b51 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239979.373418:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fc00/0x8c5345f1c1ec5b51 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239979.373424:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fc00/0x8c5345f1c1ec5b51 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239979.373430:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5ee29fc00 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:2.0:1782239979.373432:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fc00/0x8c5345f1c1ec5b51 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239979.373450:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fc00/0x8c5345f1c1ec5b51 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239979.373457:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff9bb5c4ed6400) 00010000:00010000:2.0:1782239979.373460:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782239979.373463:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fc00/0x8c5345f1c1ec5b51 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239979.373468:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fc00/0x8c5345f1c1ec5b51 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239979.373484:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e200/0x8c5345f1c1ec5b58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239979.373490:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e200/0x8c5345f1c1ec5b58 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239979.373496:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e200/0x8c5345f1c1ec5b58 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239979.373501:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5ee29e200 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:2.0:1782239979.373503:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e200/0x8c5345f1c1ec5b58 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239979.373509:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e200/0x8c5345f1c1ec5b58 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239979.373515:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bb5c55de700) 00010000:00010000:2.0:1782239979.373517:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782239979.373520:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e200/0x8c5345f1c1ec5b58 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239979.373536:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e200/0x8c5345f1c1ec5b58 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239979.373639:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+61:11584:x1868813738011392:12345-192.168.203.32@tcp:34:lhsmtool_posix.0 Request processed in 669us (1150us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239979.373648:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 216 00000100:00100000:3.0:1782239979.376952:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239979.377050:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738011648 00000100:00100000:2.0:1782239979.377063:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738011648 00000100:00100000:2.0:1782239979.377142:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 217 00000100:00100000:2.0:1782239979.377155:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+61:11584:x1868813738011648:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782239979.377195:0:6611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782239979.377231:0:6611:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29f200/0x8c5345f1c1ec5b5f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e804 expref: -99 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239979.377379:0:6611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fe00/0x8c5345f1c1ec5b66 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239979.377399:0:6611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fe00/0x8c5345f1c1ec5b66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239979.377412:0:6611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fe00/0x8c5345f1c1ec5b66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782239979.377426:0:6611:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1782239979.377563:0:6611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fe00/0x8c5345f1c1ec5b66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239979.377571:0:6611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fe00/0x8c5345f1c1ec5b66 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239979.377598:0:6611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fe00/0x8c5345f1c1ec5b66 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239979.377605:0:6611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5ee29fe00 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:2.0:1782239979.377610:0:6611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fe00/0x8c5345f1c1ec5b66 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239979.377619:0:6611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fe00/0x8c5345f1c1ec5b66 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239979.377634:0:6611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bb5c55de700) 00010000:00010000:2.0:1782239979.377637:0:6611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1782239979.377642:0:6611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fe00/0x8c5345f1c1ec5b66 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239979.377649:0:6611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fe00/0x8c5345f1c1ec5b66 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239979.377702:0:6611:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29f200/0x8c5345f1c1ec5b5f lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e804 expref: 63 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239979.377714:0:6611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bb5d0df4b00) 00010000:00010000:2.0:1782239979.377716:0:6611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782239979.377720:0:6611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29f200/0x8c5345f1c1ec5b5f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e804 expref: 63 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239979.377730:0:6611:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5ee29f200, rc 0) 00000100:00100000:2.0:1782239979.377858:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+62:11584:x1868813738011648:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 705us (918us total) trans 4294967504 rc 301/301 00000100:00100000:2.0:1782239979.377876:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 217 00000100:00100000:1.0:1782239979.382942:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239979.383143:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738011776 00000100:00100000:2.0:1782239979.383158:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738011776 00000100:00100000:2.0:1782239979.383420:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 218 00000100:00100000:2.0:1782239979.383430:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7d0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+62:11584:x1868813738011776:12345-192.168.203.32@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1782239979.383477:0:5791:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1782239979.383608:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7d0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+62:11584:x1868813738011776:12345-192.168.203.32@tcp:53:lhsmtool_posix.0 Request processed in 178us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239979.383617:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 218 00000100:00100000:1.0:1782239979.389310:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239979.389590:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738012032 00000100:00100000:2.0:1782239979.389604:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738012032 00000100:00100000:2.0:1782239979.389687:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 219 00000100:00100000:2.0:1782239979.389700:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7d0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+62:11584:x1868813738012032:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782239979.389731:0:6611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782239979.389735:0:6611:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1782239979.389807:0:6611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec5b04 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e7e8 expref: 62 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239979.389834:0:6611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bb5c30e4000) 00010000:00010000:2.0:1782239979.389840:0:6611:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782239979.389858:0:6611:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fa00/0x8c5345f1c1ec5b74 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e80b expref: -99 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782239979.390447:0:6611:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:2.0:1782239979.390716:0:6611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e000/0x8c5345f1c1ec5b7b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239979.390811:0:6611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e000/0x8c5345f1c1ec5b7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239979.390826:0:6611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e000/0x8c5345f1c1ec5b7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239979.390900:0:6611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fa00/0x8c5345f1c1ec5b74 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e80b expref: 64 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239979.390932:0:6611:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e000/0x8c5345f1c1ec5b7b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e80b expref: 63 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239979.390941:0:6611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9bb5c4ed6d00) 00010000:00010000:2.0:1782239979.390943:0:6611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782239979.390947:0:6611:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5ee29e000, rc 0) 00000100:00100000:2.0:1782239979.391028:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7d0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+63:11584:x1868813738012032:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 1331us (1733us total) trans 4294967505 rc 0/0 00000100:00100000:2.0:1782239979.391039:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 219 00000100:00100000:0.0:1782239979.403165:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239979.403264:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738012288 00000100:00100000:1.0:1782239979.403279:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738012288 00000100:00100000:1.0:1782239979.403354:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 220 00000100:00100000:1.0:1782239979.403367:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fbf25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+63:11584:x1868813738012288:12345-192.168.203.32@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1782239979.403447:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782239979.403484:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e000/0x8c5345f1c1ec5b7b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e80b expref: 63 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239979.403509:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9bb5c4ed6d00) 00010000:00010000:1.0:1782239979.403523:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782239979.403551:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38200/0x8c5345f1c1ec5b89 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239979.403589:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38200/0x8c5345f1c1ec5b89 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239979.403600:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38200/0x8c5345f1c1ec5b89 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239979.403618:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39e00/0x8c5345f1c1ec5b90 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x4f08bf4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239979.403625:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39e00/0x8c5345f1c1ec5b90 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x4f08bf4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239979.403631:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39e00/0x8c5345f1c1ec5b90 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x4f08bf4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239979.403730:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38200/0x8c5345f1c1ec5b89 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239979.403739:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38200/0x8c5345f1c1ec5b89 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239979.403771:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38200/0x8c5345f1c1ec5b89 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239979.403778:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f7e38200 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:1.0:1782239979.403783:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38200/0x8c5345f1c1ec5b89 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239979.403791:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38200/0x8c5345f1c1ec5b89 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239979.403799:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bb5c30e4000) 00010000:00010000:1.0:1782239979.403808:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782239979.403812:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38200/0x8c5345f1c1ec5b89 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239979.403819:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38200/0x8c5345f1c1ec5b89 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239979.403829:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39e00/0x8c5345f1c1ec5b90 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x4f08bf4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239979.403836:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39e00/0x8c5345f1c1ec5b90 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x4f08bf4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239979.403842:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39e00/0x8c5345f1c1ec5b90 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x4f08bf4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239979.403847:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f7e39e00 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:1.0:1782239979.403850:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39e00/0x8c5345f1c1ec5b90 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x4f08bf4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239979.403855:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39e00/0x8c5345f1c1ec5b90 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x4f08bf4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239979.403862:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x4f08bf4 (ffff9bb5c30e4200) 00010000:00010000:1.0:1782239979.403864:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782239979.403866:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39e00/0x8c5345f1c1ec5b90 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x4f08bf4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239979.403872:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39e00/0x8c5345f1c1ec5b90 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x4f08bf4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239979.403973:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fbf25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+62:11584:x1868813738012288:12345-192.168.203.32@tcp:36:lhsmtool_posix.0 Request processed in 608us (822us total) trans 0 rc -2/-2 00000100:00100000:1.0:1782239979.403989:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 220 00000100:00100000:1.0:1782239979.418999:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239979.419337:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738012416 00000100:00100000:2.0:1782239979.419351:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738012416 00000100:00100000:2.0:1782239979.419430:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 221 00000100:00100000:2.0:1782239979.419443:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7d0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+62:11584:x1868813738012416:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782239979.419472:0:6611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782239979.419503:0:6611:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fa00/0x8c5345f1c1ec5b97 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e812 expref: -99 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239979.419554:0:6611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec5b9e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239979.419593:0:6611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec5b9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239979.419609:0:6611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec5b9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239979.419731:0:6611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fa00/0x8c5345f1c1ec5b97 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e812 expref: 64 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239979.419793:0:6611:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec5b9e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e812 expref: 63 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239979.419804:0:6611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9bb5c4ed6400) 00010000:00010000:2.0:1782239979.419807:0:6611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1782239979.419811:0:6611:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5ee29ea00, rc 0) 00000100:00100000:2.0:1782239979.420018:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7d0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+63:11584:x1868813738012416:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 577us (1032us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239979.420027:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 221 00000100:00100000:3.0:1782239979.427099:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239979.427730:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738012672 00000100:00100000:2.0:1782239979.427778:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738012672 00000100:00100000:2.0:1782239979.427857:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 222 00000100:00100000:2.0:1782239979.427869:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ffd6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+63:11584:x1868813738012672:12345-192.168.203.32@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1782239979.427995:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fa00/0x8c5345f1c1ec5ba5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239979.428018:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fa00/0x8c5345f1c1ec5ba5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239979.428058:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fa00/0x8c5345f1c1ec5ba5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782239979.428456:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:2.0:1782239979.428896:0:5791:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 358501146187ns, next at 359501141257ns, rc = 0 00000004:00010000:2.0:1782239979.429040:0:5791:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002e34de86 reply state 000000000efcdf57 transno 4294967506 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fa00/0x8c5345f1c1ec5ba5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239979.429054:0:5791:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782239979.429943:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ffd6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+65:11584:x1868813738012672:12345-192.168.203.32@tcp:36:lhsmtool_posix.0 Request processed in 2063us (2847us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1782239979.429954:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 222 00010000:00010000:3.0:1782239979.434466:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fa00/0x8c5345f1c1ec5ba5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239979.434490:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fa00/0x8c5345f1c1ec5ba5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239979.434499:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fa00/0x8c5345f1c1ec5ba5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239979.434529:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5ee29fa00 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:3.0:1782239979.434535:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fa00/0x8c5345f1c1ec5ba5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239979.434544:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fa00/0x8c5345f1c1ec5ba5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239979.434577:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9bb5c4ed6400) 00010000:00010000:3.0:1782239979.434581:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1782239979.434588:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fa00/0x8c5345f1c1ec5ba5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239979.434594:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fa00/0x8c5345f1c1ec5ba5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239979.436058:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239979.436341:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738012800 00000100:00100000:2.0:1782239979.436354:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738012800 00000100:00100000:3.0:1782239979.436981:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 223 00000100:00100000:3.0:1782239979.436999:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ffd6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+64:11584:x1868813738012800:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782239979.437045:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782239979.437071:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26800/0x8c5345f1c1ec5bac lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e819 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239979.437170:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26800/0x8c5345f1c1ec5bac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e819 expref: 65 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239979.437188:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26800/0x8c5345f1c1ec5bac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e819 expref: 65 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239979.437345:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9bb5c4ed6400) 00010000:00010000:3.0:1782239979.437349:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782239979.437353:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5f7e26800, rc 0) 00000100:00100000:3.0:1782239979.437445:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ffd6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+65:11584:x1868813738012800:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 451us (1397us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239979.437454:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 223 00000100:00100000:1.0:1782239979.442322:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239979.442441:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738012928 00000100:00100000:2.0:1782239979.442455:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738012928 00000100:00100000:2.0:1782239979.442553:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 62 00000100:00100000:2.0:1782239979.442566:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7e62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+9:2344:x1868813738012928:12345-192.168.203.32@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1782239979.442581:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782239979.443343:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7e62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+10:2344:x1868813738012928:12345-192.168.203.32@tcp:2:lhsmtool_posix.0 Request processed in 775us (1134us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1782239979.443354:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 62 00000100:00100000:1.0:1782239979.448896:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239979.449604:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738013184 00000100:00100000:2.0:1782239979.449620:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738013184 00000100:00100000:2.0:1782239979.449709:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 60 00000100:00100000:2.0:1782239979.449720:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7e63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+65:11584:x1868813738013184:12345-192.168.203.32@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1782239979.450582:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7e63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+66:11584:x1868813738013184:12345-192.168.203.32@tcp:35:lhsmtool_posix.0 Request processed in 856us (1692us total) trans 4294967507 rc 0/0 00000100:00100000:0.0:1782239979.450594:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 60 00000100:00100000:3.0:1782239979.456005:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239979.457158:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738013440 00000100:00100000:0.0:1782239979.457175:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738013440 00000100:00100000:0.0:1782239979.457569:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 224 00000100:00100000:0.0:1782239979.457583:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb6018cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+66:11584:x1868813738013440:12345-192.168.203.32@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1782239979.457800:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb6018cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+66:11584:x1868813738013440:12345-192.168.203.32@tcp:57:lhsmtool_posix.0 Request processed in 219us (1811us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239979.457817:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 224 00000100:00100000:1.0:1782239979.469656:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239979.470008:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738013568 00000100:00100000:3.0:1782239979.470023:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738013568 00000100:00100000:3.0:1782239979.470101:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 225 00000100:00100000:3.0:1782239979.470113:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7e60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+66:11584:x1868813738013568:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782239979.470147:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782239979.470183:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26400/0x8c5345f1c1ec5bb3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e820 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239979.470288:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26e00/0x8c5345f1c1ec5bba lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239979.470307:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26e00/0x8c5345f1c1ec5bba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239979.470321:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26e00/0x8c5345f1c1ec5bba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782239979.470371:0:5790:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782239979.470393:0:5790:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26e00/0x8c5345f1c1ec5bba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239979.470452:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26400/0x8c5345f1c1ec5bb3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e820 expref: 68 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239979.470476:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26e00/0x8c5345f1c1ec5bba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e820 expref: 67 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239979.470486:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9bb5c4ed6400) 00010000:00010000:3.0:1782239979.470489:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1782239979.470493:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5f7e26e00, rc 0) 00000100:00100000:3.0:1782239979.470583:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7e60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+67:11584:x1868813738013568:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 471us (943us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239979.470591:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 225 00000100:00100000:1.0:1782239979.485319:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239979.485534:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738013696 00000100:00100000:3.0:1782239979.485548:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738013696 00000100:00100000:3.0:1782239979.485631:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 63 00000100:00100000:3.0:1782239979.485643:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc08d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+10:2345:x1868813738013696:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782239979.485667:0:6590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782239979.485693:0:6590:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005dc63bde/0x8c5345f1c1ec5bc1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e827 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782239979.485724:0:6590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a3ad2eb, blocks: 0x1 00010000:00010000:3.0:1782239979.485793:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=358s v=(0 0) 00010000:00010000:3.0:1782239979.485798:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782239979.485810:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005dc63bde/0x8c5345f1c1ec5bc1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e827 expref: 11 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239979.485853:0:6590:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005dc63bde/0x8c5345f1c1ec5bc1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e827 expref: 11 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239979.485869:0:6590:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5f7e26400, rc 0) 00000100:00100000:3.0:1782239979.485945:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc08d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+11:2345:x1868813738013696:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 304us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239979.485953:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 63 00000100:00100000:1.0:1782239979.492984:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239979.493910:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738013952 00000100:00100000:0.0:1782239979.493924:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738013952 00000100:00100000:1.0:1782239979.506138:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 226 00000100:00100000:1.0:1782239979.506157:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc08f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+67:11584:x1868813738013952:12345-192.168.203.32@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1782239979.506343:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc08f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+67:11584:x1868813738013952:12345-192.168.203.32@tcp:57:lhsmtool_posix.0 Request processed in 190us (13373us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239979.506352:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 226 00000100:00100000:1.0:1782239979.517595:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239979.517806:0:8312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738014080 00000100:00100000:0.0:1782239979.517820:0:8312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738014080 00000100:00100000:0.0:1782239979.517891:0:8312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 64 00000100:00100000:0.0:1782239979.517911:0:8312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc08e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+11:11584:x1868813738014080:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782239979.517935:0:8312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782239979.517962:0:8312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004f9c7d81/0x8c5345f1c1ec5bc8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e82e expref: -99 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239979.518004:0:8312:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005dc63bde/0x8c5345f1c1ec5bc1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e827 expref: 12 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239979.518015:0:8312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782239979.518020:0:8312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782239979.518026:0:8312:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f9c7d81/0x8c5345f1c1ec5bc8 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e82e expref: 12 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239979.518103:0:8312:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005dc63bde/0x8c5345f1c1ec5bc1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e827 expref: 12 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239979.518118:0:8312:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005dc63bde/0x8c5345f1c1ec5bc1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e827 expref: 12 pid: 6590 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782239979.518146:0:8312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5e8eeca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8312:1868813758971136:192.168.203.32@tcp:104: 00000100:00100000:0.0:1782239979.518257:0:8312:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5f7b47780 going to sleep for 11 seconds 00000100:00100000:0.0:1782239979.534197:0:8312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5e8eeca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8312:1868813758971136:192.168.203.32@tcp:104: 00010000:00010000:0.0:1782239979.534252:0:8312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004f9c7d81/0x8c5345f1c1ec5bc8 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e82e expref: 12 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239979.534278:0:8312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5f4436000, rc 0) 00000100:00100000:0.0:1782239979.534370:0:8312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc08e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+12:11584:x1868813738014080:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 16469us (16789us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239979.534381:0:8312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 64 00000100:00100000:1.0:1782239979.543184:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239979.543248:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239979.543289:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239979.543333:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239979.543432:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738014208 00000100:00100000:2.0:1782239979.543462:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738014208 00000100:00100000:2.0:1782239979.543534:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 298 00000100:00100000:2.0:1782239979.543545:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5decbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afaefb1a-536b-42a3-a3ff-47200f8611c3+13:2344:x1868813738014208:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:2.0:1782239979.543657:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5decbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afaefb1a-536b-42a3-a3ff-47200f8611c3+13:2344:x1868813738014208:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 112us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239979.543666:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 298 00000100:00100000:3.0:1782239979.543898:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738014336 00000100:00100000:3.0:1782239979.543913:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738014336 00000100:00100000:3.0:1782239979.543958:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 96 00000100:00100000:3.0:1782239979.543966:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc08f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+7:2344:x1868813738014336:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:3.0:1782239979.544000:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc08f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+7:2344:x1868813738014336:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 35us (833us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239979.544007:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 96 00000100:00100000:0.0:1782239979.544384:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738014592 00000100:00100000:0.0:1782239979.544390:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738014592 00010000:00010000:0.0:1782239979.544424:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005dc63bde/0x8c5345f1c1ec5bc1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e827 expref: 12 pid: 6590 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782239979.544459:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 81 00000100:00100000:0.0:1782239979.544467:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d0218850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+12:2345:x1868813738014592:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782239979.544497:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782239979.544526:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005dc63bde/0x8c5345f1c1ec5bc1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e827 expref: 12 pid: 6590 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239979.544540:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005dc63bde/0x8c5345f1c1ec5bc1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e827 expref: 12 pid: 6590 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239979.544578:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005dc63bde/0x8c5345f1c1ec5bc1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e827 expref: 12 pid: 6590 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239979.544608:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782239979.544614:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782239979.544624:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004f9c7d81/0x8c5345f1c1ec5bc8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e82e expref: 11 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239979.544635:0:5777:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f9c7d81/0x8c5345f1c1ec5bc8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e82e expref: 11 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239979.544681:0:5777:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000004f9c7d81/0x8c5345f1c1ec5bc8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e82e expref: 11 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782239979.544698:0:5777:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5e8eeca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5777:1868813758971264:192.168.203.32@tcp:105: 00000100:00100000:0.0:1782239979.544840:0:5777:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5f7b47780 going to sleep for 11 seconds 00000100:00100000:0.0:1782239979.544859:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738014464 00000100:00100000:0.0:1782239979.544864:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738014464 00000100:00100000:0.0:1782239979.544927:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 166 00000100:00100000:0.0:1782239979.544946:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc08df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f135cc01-3d42-4f2a-80ff-79724f1d3285+5:2344:x1868813738014464:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:0.0:1782239979.544987:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc08df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f135cc01-3d42-4f2a-80ff-79724f1d3285+5:2344:x1868813738014464:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 42us (1697us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239979.544994:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 166 00000100:00080000:3.0:1782239979.545318:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782239979.549346:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239979.549494:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738014720 00000100:00100000:2.0:1782239979.549507:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738014720 00002000:00100000:2.0:1782239979.549581:0:6595:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff9bb5fc08f480 x1868813738014720/t0(0) o4->36dd742b-25b8-431e-bf41-75f2fff47ffb@192.168.203.32@tcp:580/0 lens 504/0 e 0 to 0 dl 1782239990 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782239979.549596:0:6595:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9bb5fc08f480 with x1868813738014720 ext(0->12) 00002000:00010000:2.0:1782239979.549611:0:6595:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bb5fc08f480 00000100:00100000:2.0:1782239979.549645:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 6 00000100:00100000:2.0:1782239979.549655:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc08f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+12:2345:x1868813738014720:12345-192.168.203.32@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1782239979.550285:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc08f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+14:2345:x1868813738014720:12345-192.168.203.32@tcp:4:lhsmtool_posix.0 Request processed in 627us (949us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1782239979.550295:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 6 00002000:00100000:2.0:1782239979.550303:0:6595:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff9bb5fc08f480 x1868813738014720/t4294967320(0) o4->36dd742b-25b8-431e-bf41-75f2fff47ffb@192.168.203.32@tcp:580/0 lens 504/448 e 0 to 0 dl 1782239990 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782239979.550312:0:6595:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9bb5fc08f480 with x1868813738014720 ext(0->12) 00002000:00010000:2.0:1782239979.550317:0:6595:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bb5fc08f480 00000100:00100000:0.0:1782239979.550568:0:5777:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5e8eeca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5777:1868813758971264:192.168.203.32@tcp:105: 00010000:00010000:0.0:1782239979.550608:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782239979.550635:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d0218850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+13:2345:x1868813738014592:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 6169us (7301us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239979.550645:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 81 00000100:00100000:2.0:1782239979.563258:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239979.563358:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738014848 00000100:00100000:1.0:1782239979.563371:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738014848 00000100:00100000:1.0:1782239979.563795:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 227 00000100:00100000:1.0:1782239979.563812:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+67:11584:x1868813738014848:12345-192.168.203.32@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1782239979.609253:0:5812:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967507 is committed 00000020:00080000:0.0:1782239979.609335:0:5812:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bb5f7b47e40 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:0.0:1782239979.609343:0:5812:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9bb5cf403700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bb5f7b47300 00000020:00080000:0.0:1782239979.609347:0:5812:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9bb5cf403e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bb5edf3ec00 00000004:00080000:0.0:1782239979.609388:0:5812:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000004:00080000:0.0:1782239979.609422:0:5812:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000004:00080000:0.0:1782239979.609441:0:5812:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:0.0:1782239979.609459:0:5812:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bb5e8e80240 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:0.0:1782239979.609462:0:5812:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9bb5dec4b800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bb5e8e80f00 00000020:00080000:0.0:1782239979.609465:0:5812:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9bb5dec4be00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bb5f7c62400 00000100:00100000:3.0:1782239979.609511:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+25:11584:x1868813738014848:12345-192.168.203.32@tcp:44:lhsmtool_posix.0 Request processed in 45698us (46382us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239979.609525:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 227 00000100:00100000:3.0:1782239979.609913:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fc08d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813758971392:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1782239979.609986:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1782239979.609998:0:5823:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000100:00100000:1.0:1782239979.610216:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758971392 00000100:00100000:1.0:1782239979.610227:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758971392 00000100:00100000:1.0:1782239979.610302:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1782239979.610336:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb6018cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1868813758971392:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1782239979.610369:0:6588:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:1.0:1782239979.610401:0:6588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eaa03260/0x8c5345f1c1ec5bcf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239979.610428:0:6588:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b25db6fd/0x8c5345f1c1ec5991 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e78d expref: 12 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239979.610438:0:6588:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1782239979.610443:0:6588:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782239979.610449:0:6588:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eaa03260/0x8c5345f1c1ec5bcf lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239979.610485:0:6588:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b25db6fd/0x8c5345f1c1ec5991 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e78d expref: 12 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239979.610501:0:6588:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b25db6fd/0x8c5345f1c1ec5991 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e78d expref: 12 pid: 8312 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239979.610514:0:6588:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f77f1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6588:1868813758971648:192.168.203.32@tcp:104: 00000100:00100000:3.0:1782239979.610938:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f77f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813758971520:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1782239979.610974:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1782239979.611074:0:5823:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00080000:3.0:1782239979.611142:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782239979.611167:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758971520 00000100:00100000:3.0:1782239979.611172:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758971520 00000100:00100000:0.0:1782239979.611262:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782239979.611270:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5e8eeca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813758971776:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1782239979.611345:0:6588:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c1254000 going to sleep for 11 seconds 00000100:00100000:3.0:1782239979.611363:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1782239979.611371:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5dee25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3306:x1868813758971520:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1782239979.611540:0:6590:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1782239979.611544:0:6590:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1782239979 00002000:00010000:3.0:1782239979.611546:0:6590:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1782239979.611548:0:6590:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1782239979 -> 1782239979 00002000:00010000:3.0:1782239979.611550:0:6590:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1782239979.611593:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5dee25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3306:x1868813758971520:12345-0@lo:2:osp-syn-0-0.0 Request processed in 222us (617us total) trans 4294967321 rc 0/0 00000100:00100000:3.0:1782239979.611601:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1782239979.611702:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1782239979.611787:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bb5f77f1c00/2, rc 0, transno 4294967321 00000100:00100000:0.0:1782239979.611795:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f77f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813758971520:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1782239979.612554:0:8312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758971776 00000100:00100000:1.0:1782239979.612564:0:8312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758971776 00000100:00100000:1.0:1782239979.612607:0:8312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1782239979.612615:0:8312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8eec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3306:x1868813758971776:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1782239979.612641:0:8312:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:1.0:1782239979.612689:0:8312:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a3ad2ea, atime: 0x6a3ad2ea, ctime: 0x6a3ad2ea, blocks: 0x1 00010000:00010000:1.0:1782239979.612698:0:8312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000733f4058/0x8c5345f1c1ec5bd6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239979.612717:0:8312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=358s v=(0 0) 00010000:00010000:1.0:1782239979.612721:0:8312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782239979.612728:0:8312:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000733f4058/0x8c5345f1c1ec5bd6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239979.612779:0:8312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000733f4058/0x8c5345f1c1ec5bd6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239979.612791:0:8312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000733f4058/0x8c5345f1c1ec5bd6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239979.612799:0:8312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000733f4058/0x8c5345f1c1ec5bd6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239979.612820:0:8312:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782239979.613617:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782239979.613630:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000733f4058/0x8c5345f1c1ec5bd6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239979.613640:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f7e39000 already unused, calling callback (ffffffffc1728ce0) 00010000:00010000:0.0:1782239979.613645:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000733f4058/0x8c5345f1c1ec5bd6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239979.613656:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000733f4058/0x8c5345f1c1ec5bd6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239979.613678:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000733f4058/0x8c5345f1c1ec5bd6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239979.613686:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000733f4058/0x8c5345f1c1ec5bd6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239979.613721:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782239979.613723:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782239979.613725:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782239979.614599:0:8312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8eec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3306:x1868813758971776:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1977us (2889us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1782239979.614613:0:8312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000004:00080000:0.0:1782239979.615312:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bb5e8eeca80/2, rc 0, transno 4294967310 00000100:00100000:0.0:1782239979.615324:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5e8eeca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813758971776:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1782239979.619993:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239979.620154:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239979.620391:0:7481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738015104 00000100:00100000:3.0:1782239979.620404:0:7481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738015104 00010000:00010000:3.0:1782239979.620460:0:7481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b25db6fd/0x8c5345f1c1ec5991 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e78d expref: 13 pid: 8312 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239979.620516:0:7481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 82 00000100:00100000:3.0:1782239979.620527:0:7481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8eca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+13:2344:x1868813738015104:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782239979.620557:0:7481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782239979.620571:0:7481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b25db6fd/0x8c5345f1c1ec5991 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e78d expref: 13 pid: 8312 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239979.620589:0:7481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b25db6fd/0x8c5345f1c1ec5991 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e78d expref: 13 pid: 8312 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239979.620737:0:7481:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782239979.620770:0:7481:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782239979.620778:0:7481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000eaa03260/0x8c5345f1c1ec5bcf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239979.620789:0:7481:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eaa03260/0x8c5345f1c1ec5bcf lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239979.620817:0:7481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782239979.620885:0:7481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8eca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+13:2344:x1868813738015104:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 359us (729us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239979.620894:0:7481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 82 00000100:00100000:0.0:1782239979.621880:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738014976 00000100:00100000:0.0:1782239979.621894:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738014976 00000100:00100000:0.0:1782239979.622337:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 68 00000100:00100000:0.0:1782239979.622353:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+13:2344:x1868813738014976:12345-192.168.203.32@tcp:16:lhsmtool_posix.0 00010000:00010000:1.0:1782239979.622586:0:6588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b25db6fd/0x8c5345f1c1ec5991 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e78d expref: 13 pid: 8312 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239979.622610:0:6588:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f77f1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6588:1868813758971648:192.168.203.32@tcp:104: 00010000:00010000:1.0:1782239979.622641:0:6588:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000eaa03260/0x8c5345f1c1ec5bcf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239979.622661:0:6588:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000eaa03260/0x8c5345f1c1ec5bcf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239979.622669:0:6588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eaa03260/0x8c5345f1c1ec5bcf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239979.622681:0:6588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eaa03260/0x8c5345f1c1ec5bcf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239979.622689:0:6588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eaa03260/0x8c5345f1c1ec5bcf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239979.622719:0:6588:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782239979.623160:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782239979.623169:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eaa03260/0x8c5345f1c1ec5bcf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239979.623178:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f7e39600 already unused, calling callback (ffffffffc1728ce0) 00010000:00010000:0.0:1782239979.623190:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eaa03260/0x8c5345f1c1ec5bcf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239979.623354:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eaa03260/0x8c5345f1c1ec5bcf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239979.623380:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eaa03260/0x8c5345f1c1ec5bcf lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239979.623387:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eaa03260/0x8c5345f1c1ec5bcf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239979.623409:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782239979.623411:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782239979.623412:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782239979.624872:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb6018cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3305:x1868813758971392:12345-0@lo:6:osp-syn-0-0.0 Request processed in 14532us (14879us total) trans 4294967322 rc 0/0 00000100:00100000:1.0:1782239979.624888:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000004:00080000:3.0:1782239979.625535:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bb5fc08d880/2, rc 0, transno 4294967322 00000100:00100000:3.0:1782239979.625545:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fc08d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813758971392:0@lo:6:osp-syn-0-0.0 00000001:00080000:2.0:1782239979.704786:0:6614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967316 is committed 00000001:00080000:2.0:1782239979.704813:0:6614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000001:00080000:2.0:1782239979.704829:0:6614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967317 is committed 00000001:00080000:2.0:1782239979.704840:0:6614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000100:00100000:0.0:1782239979.705032:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+7:2344:x1868813738014976:12345-192.168.203.32@tcp:16:lhsmtool_posix.0 Request processed in 82674us (85045us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239979.705721:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 68 00000100:00100000:2.0:1782239979.708110:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239979.708416:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738015360 00000100:00100000:0.0:1782239979.708429:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738015360 00000100:00100000:0.0:1782239979.708509:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 228 00000100:00100000:0.0:1782239979.708520:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fff00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+21:11584:x1868813738015360:12345-192.168.203.32@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1782239979.708611:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782239979.708649:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26e00/0x8c5345f1c1ec5bba lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e820 expref: 21 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239979.708675:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9bb5c4ed6400) 00010000:00010000:0.0:1782239979.708681:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782239979.708722:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436800/0x8c5345f1c1ec5bdd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239979.708738:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436800/0x8c5345f1c1ec5bdd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239979.708814:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436800/0x8c5345f1c1ec5bdd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782239979.709662:0:5790:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c7e9948d reply state 000000001cba89f1 transno 4294967508 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436800/0x8c5345f1c1ec5bdd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782239979.709679:0:5790:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782239979.710578:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fff00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+22:11584:x1868813738015360:12345-192.168.203.32@tcp:36:lhsmtool_posix.0 Request processed in 2043us (2467us total) trans 4294967508 rc 0/0 00000100:00100000:0.0:1782239979.710593:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 228 00000100:00100000:3.0:1782239979.714844:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239979.715670:0:8312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738015488 00000100:00100000:1.0:1782239979.715684:0:8312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738015488 00000100:00100000:1.0:1782239979.715805:0:8312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 69 00000100:00100000:1.0:1782239979.715817:0:8312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5dee24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+7:2344:x1868813738015488:12345-192.168.203.32@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1782239979.716706:0:8312:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1782239979.716715:0:8312:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1782239979 -> 1782239978 00002000:00010000:1.0:1782239979.716717:0:8312:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1782239978 00002000:00010000:1.0:1782239979.716720:0:8312:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1782239979 -> 1782239978 00002000:00010000:1.0:1782239979.716722:0:8312:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1782239979.716962:0:8312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5dee24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+8:2344:x1868813738015488:12345-192.168.203.32@tcp:2:lhsmtool_posix.0 Request processed in 1142us (2127us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1782239979.716973:0:8312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 69 00010000:00010000:0.0:1782239979.717522:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436800/0x8c5345f1c1ec5bdd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239979.717536:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436800/0x8c5345f1c1ec5bdd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239979.717558:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436800/0x8c5345f1c1ec5bdd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239979.717582:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f4436800 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:0.0:1782239979.717589:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436800/0x8c5345f1c1ec5bdd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239979.717598:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436800/0x8c5345f1c1ec5bdd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239979.717620:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9bb5c4ed6400) 00010000:00010000:0.0:1782239979.717623:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782239979.717630:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436800/0x8c5345f1c1ec5bdd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239979.717637:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436800/0x8c5345f1c1ec5bdd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239979.720743:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239979.720974:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738015744 00000100:00100000:1.0:1782239979.720987:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738015744 00000100:00100000:1.0:1782239979.721151:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 229 00000100:00100000:1.0:1782239979.721164:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fff03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+21:11584:x1868813738015744:12345-192.168.203.32@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1782239979.721457:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39600/0x8c5345f1c1ec5be4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239979.721479:0:5792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec5b9e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e812 expref: 21 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239979.721490:0:5792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39600/0x8c5345f1c1ec5be4 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239979.721537:0:5792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec5b9e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e812 expref: 21 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239979.721553:0:5792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec5b9e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e812 expref: 21 pid: 6611 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239979.721572:0:5792:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f77f1880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5792:1868813758971904:192.168.203.32@tcp:104: 00000100:00100000:1.0:1782239979.721733:0:5792:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c1254780 going to sleep for 11 seconds 00000100:00100000:2.0:1782239979.725668:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239979.725783:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738015872 00000100:00100000:3.0:1782239979.725796:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738015872 00010000:00010000:3.0:1782239979.725848:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec5b9e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e812 expref: 22 pid: 6611 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239979.725889:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 83 00000100:00100000:3.0:1782239979.725909:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fff01880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+22:2344:x1868813738015872:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782239979.725931:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782239979.725939:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec5b9e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e812 expref: 22 pid: 6611 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239979.725955:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec5b9e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e812 expref: 22 pid: 6611 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239979.726016:0:5775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9bb5c4ed6400) 00010000:00010000:3.0:1782239979.726023:0:5775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39600/0x8c5345f1c1ec5be4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239979.726033:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39600/0x8c5345f1c1ec5be4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239979.726042:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39600/0x8c5345f1c1ec5be4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239979.726143:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782239979.726419:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fff01880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+22:2344:x1868813738015872:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 518us (764us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239979.726428:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 83 00010000:00010000:1.0:1782239979.727703:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ea00/0x8c5345f1c1ec5b9e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e812 expref: 21 pid: 6611 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239979.727732:0:5792:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f77f1880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5792:1868813758971904:192.168.203.32@tcp:104: 00010000:00010000:1.0:1782239979.727873:0:5792:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39600/0x8c5345f1c1ec5be4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239979.727885:0:5792:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39600/0x8c5345f1c1ec5be4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239979.727892:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39600/0x8c5345f1c1ec5be4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239979.727943:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39600/0x8c5345f1c1ec5be4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239979.727951:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39600/0x8c5345f1c1ec5be4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239979.727959:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39600/0x8c5345f1c1ec5be4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239979.727966:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f7e39600 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:1.0:1782239979.727970:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39600/0x8c5345f1c1ec5be4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239979.727979:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39600/0x8c5345f1c1ec5be4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239979.727996:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9bb5c4ed6400) 00010000:00010000:1.0:1782239979.727999:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1782239979.728004:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39600/0x8c5345f1c1ec5be4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239979.728011:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39600/0x8c5345f1c1ec5be4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239979.728115:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fff03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+20:11584:x1868813738015744:12345-192.168.203.32@tcp:55:lhsmtool_posix.0 Request processed in 6953us (7387us total) trans 0 rc -22/-22 00000100:00100000:1.0:1782239979.728127:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 229 00000100:00100000:3.0:1782239979.731153:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239979.731627:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738016000 00000100:00100000:1.0:1782239979.731642:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738016000 00000100:00100000:1.0:1782239979.731710:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 70 00000100:00100000:1.0:1782239979.731722:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7811f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+8:2346:x1868813738016000:12345-192.168.203.32@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1782239979.731813:0:6588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000733f4058/0x8c5345f1c1ec5beb lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239979.731838:0:6588:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004f9c7d81/0x8c5345f1c1ec5bc8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e82e expref: 8 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239979.731849:0:6588:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782239979.731854:0:6588:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782239979.731859:0:6588:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000733f4058/0x8c5345f1c1ec5beb lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239979.731915:0:6588:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004f9c7d81/0x8c5345f1c1ec5bc8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e82e expref: 8 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239979.731932:0:6588:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004f9c7d81/0x8c5345f1c1ec5bc8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e82e expref: 8 pid: 8312 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239979.731949:0:6588:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f77f1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6588:1868813758972032:192.168.203.32@tcp:104: 00000100:00100000:1.0:1782239979.732087:0:6588:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c1254780 going to sleep for 11 seconds 00000100:00100000:3.0:1782239979.736701:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239979.737039:0:7481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738016128 00000100:00100000:0.0:1782239979.737062:0:7481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738016128 00010000:00010000:0.0:1782239979.737115:0:7481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004f9c7d81/0x8c5345f1c1ec5bc8 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e82e expref: 9 pid: 8312 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782239979.737418:0:7481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 84 00000100:00100000:0.0:1782239979.737434:0:7481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7811c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+9:2345:x1868813738016128:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782239979.737455:0:7481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782239979.737482:0:7481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004f9c7d81/0x8c5345f1c1ec5bc8 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e82e expref: 9 pid: 8312 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239979.737497:0:7481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004f9c7d81/0x8c5345f1c1ec5bc8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e82e expref: 9 pid: 8312 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239979.737551:0:7481:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782239979.737555:0:7481:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782239979.737562:0:7481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000733f4058/0x8c5345f1c1ec5beb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239979.737574:0:7481:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000733f4058/0x8c5345f1c1ec5beb lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239979.737598:0:7481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782239979.737666:0:7481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7811c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+9:2345:x1868813738016128:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 236us (979us total) trans 0 rc 0/0 00010000:00010000:1.0:1782239979.737791:0:6588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004f9c7d81/0x8c5345f1c1ec5bc8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e82e expref: 9 pid: 8312 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239979.737811:0:6588:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f77f1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6588:1868813758972032:192.168.203.32@tcp:104: 00010000:00010000:1.0:1782239979.737839:0:6588:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000733f4058/0x8c5345f1c1ec5beb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239979.737851:0:6588:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000733f4058/0x8c5345f1c1ec5beb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239979.737859:0:6588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000733f4058/0x8c5345f1c1ec5beb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239979.737886:0:6588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000733f4058/0x8c5345f1c1ec5beb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239979.737895:0:6588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000733f4058/0x8c5345f1c1ec5beb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239979.737915:0:6588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000733f4058/0x8c5345f1c1ec5beb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239979.737923:0:6588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f7e39000 already unused, calling callback (ffffffffc1728ce0) 00010000:00010000:1.0:1782239979.737927:0:6588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000733f4058/0x8c5345f1c1ec5beb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239979.737949:0:6588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000733f4058/0x8c5345f1c1ec5beb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239979.737962:0:6588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000733f4058/0x8c5345f1c1ec5beb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239979.737970:0:6588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000733f4058/0x8c5345f1c1ec5beb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239979.738023:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7811f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+8:2346:x1868813738016000:12345-192.168.203.32@tcp:1:lhsmtool_posix.0 Request processed in 6305us (6885us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239979.738033:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 70 00000100:00100000:0.0:1782239979.741521:0:7481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 84 00000100:00100000:0.0:1782239979.742454:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239979.742648:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738016384 00000100:00100000:2.0:1782239979.742662:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738016384 00000100:00100000:2.0:1782239979.742790:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 230 00000100:00100000:2.0:1782239979.742802:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5c513ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+20:11584:x1868813738016384:12345-192.168.203.32@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1782239979.742924:0:6611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fc00/0x8c5345f1c1ec5bf2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239979.742946:0:6611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fc00/0x8c5345f1c1ec5bf2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239979.742961:0:6611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fc00/0x8c5345f1c1ec5bf2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239979.743610:0:6611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e400/0x8c5345f1c1ec5bf9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239979.743629:0:6611:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26800/0x8c5345f1c1ec5bac lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e819 expref: 21 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239979.743639:0:6611:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e400/0x8c5345f1c1ec5bf9 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239979.743689:0:6611:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26800/0x8c5345f1c1ec5bac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e819 expref: 21 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239979.743726:0:6611:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26800/0x8c5345f1c1ec5bac lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e819 expref: 21 pid: 5790 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239979.743743:0:6611:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f7ce0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6611:1868813758972160:192.168.203.32@tcp:104: 00000100:00100000:2.0:1782239979.743909:0:6611:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5e8e80300 going to sleep for 11 seconds 00010000:00010000:1.0:1782239979.744099:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782239979.747081:0:6611:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f7ce0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6611:1868813758972160:192.168.203.32@tcp:104: 00010000:00010000:2.0:1782239979.747123:0:6611:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e400/0x8c5345f1c1ec5bf9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239979.749002:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239979.749496:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738016512 00000100:00100000:2.0:1782239979.749508:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738016512 00010000:00010000:2.0:1782239979.749581:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26800/0x8c5345f1c1ec5bac lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e819 expref: 22 pid: 5790 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239979.749635:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 85 00000100:00100000:2.0:1782239979.749646:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7810000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+22:2345:x1868813738016512:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782239979.749665:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782239979.749673:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26800/0x8c5345f1c1ec5bac lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e819 expref: 22 pid: 5790 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239979.749688:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26800/0x8c5345f1c1ec5bac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e819 expref: 22 pid: 5790 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239979.749717:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26800/0x8c5345f1c1ec5bac lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e819 expref: 22 pid: 5790 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239979.749801:0:5775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9bb5c4ed6400) 00010000:00010000:2.0:1782239979.749809:0:5775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e400/0x8c5345f1c1ec5bf9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239979.749819:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e400/0x8c5345f1c1ec5bf9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239979.749827:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e400/0x8c5345f1c1ec5bf9 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239979.749859:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782239979.749935:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7810000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+21:2345:x1868813738016512:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 291us (948us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239979.749944:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 85 00010000:00010000:3.0:1782239979.750732:0:6611:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e400/0x8c5345f1c1ec5bf9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239979.750778:0:6611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e400/0x8c5345f1c1ec5bf9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782239979.751067:0:6611:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:3.0:1782239979.751535:0:6611:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:3.0:1782239979.751816:0:6611:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:3.0:1782239979.751942:0:6611:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f7812a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6611:1868813758972288:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1782239979.753857:0:6611:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239979.754159:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758972288 00000100:00100000:0.0:1782239979.754171:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758972288 00000100:00100000:2.0:1782239979.754344:0:6611:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5d1cd0d80 going to sleep for 11 seconds 00000100:00100000:0.0:1782239979.754356:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1782239979.754367:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f77a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6611:x1868813758972288:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1782239979.754516:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f77a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6611:x1868813758972288:12345-0@lo:1000:mdt00_003.0 Request processed in 150us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239979.754529:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1782239979.754702:0:6611:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:2.0:1782239979.754710:0:6611:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:2.0:1782239979.754735:0:6611:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bb5f77f1c00, transno 4294967321 00000100:00100000:2.0:1782239979.754846:0:6611:0:(client.c:3155:ptlrpc_free_committed()) @@@ stopping search req@ffff9bb5fc08d880 x1868813758971392/t4294967322(4294967322) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1782239995 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782239979.754862:0:6611:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f7812a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6611:1868813758972288:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1782239979.755502:0:6611:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:2.0:1782239979.755619:0:6611:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f7ce0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6611:1868813758972416:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1782239979.755685:0:6611:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239979.755721:0:6611:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5e8e80cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1782239979.755893:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758972416 00000100:00100000:0.0:1782239979.755910:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758972416 00000100:00100000:0.0:1782239979.755960:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1782239979.755969:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7ce2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6611:x1868813758972416:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1782239979.756210:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7ce2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6611:x1868813758972416:12345-0@lo:1000:mdt00_003.0 Request processed in 240us (523us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1782239979.756227:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1782239979.756521:0:6611:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f7ce0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6611:1868813758972416:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1782239979.756573:0:6611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e400/0x8c5345f1c1ec5bf9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239979.756584:0:6611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e400/0x8c5345f1c1ec5bf9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239979.756592:0:6611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e400/0x8c5345f1c1ec5bf9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239979.756599:0:6611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5ee29e400 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:3.0:1782239979.756604:0:6611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e400/0x8c5345f1c1ec5bf9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239979.756613:0:6611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e400/0x8c5345f1c1ec5bf9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239979.756634:0:6611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9bb5c4ed6400) 00010000:00010000:3.0:1782239979.756638:0:6611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782239979.756643:0:6611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e400/0x8c5345f1c1ec5bf9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239979.756650:0:6611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e400/0x8c5345f1c1ec5bf9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239979.756686:0:6611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e800/0x8c5345f1c1ec5b3c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239979.756694:0:6611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e800/0x8c5345f1c1ec5b3c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239979.756700:0:6611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e800/0x8c5345f1c1ec5b3c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239979.756716:0:6611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5ee29e800 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:3.0:1782239979.756719:0:6611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e800/0x8c5345f1c1ec5b3c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239979.756725:0:6611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e800/0x8c5345f1c1ec5b3c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239979.756735:0:6611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bb5c55de700) 00010000:00010000:3.0:1782239979.756737:0:6611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782239979.756745:0:6611:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e600/0x8c5345f1c1ec5b43 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e7fd expref: 24 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239979.756799:0:6611:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e600/0x8c5345f1c1ec5b43 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e7fd expref: 24 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239979.756809:0:6611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e600/0x8c5345f1c1ec5b43 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e7fd expref: 24 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239979.756844:0:6611:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e600/0x8c5345f1c1ec5b43 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e7fd expref: 24 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782239979.756860:0:6611:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f77a6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6611:1868813758972544:192.168.203.32@tcp:105: 00000100:00100000:3.0:1782239979.756955:0:6611:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5d1bb33c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782239979.761443:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239979.761558:0:6611:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f77a6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6611:1868813758972544:192.168.203.32@tcp:105: 00010000:00010000:2.0:1782239979.761616:0:6611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e800/0x8c5345f1c1ec5b3c lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239979.761629:0:6611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e800/0x8c5345f1c1ec5b3c lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239979.761674:0:6611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ee00/0x8c5345f1c1ec5c00 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239979.761690:0:6611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ee00/0x8c5345f1c1ec5c00 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239979.761703:0:6611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ee00/0x8c5345f1c1ec5c00 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239979.761715:0:6611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ee00/0x8c5345f1c1ec5c00 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239979.761722:0:6611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ee00/0x8c5345f1c1ec5c00 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239979.761728:0:6611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ee00/0x8c5345f1c1ec5c00 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239979.761734:0:6611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5ee29ee00 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:2.0:1782239979.761738:0:6611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ee00/0x8c5345f1c1ec5c00 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239979.761782:0:6611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ee00/0x8c5345f1c1ec5c00 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239979.761798:0:6611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bb5c55de700) 00010000:00010000:2.0:1782239979.761801:0:6611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782239979.761812:0:6611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ee00/0x8c5345f1c1ec5c00 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239979.761819:0:6611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ee00/0x8c5345f1c1ec5c00 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239979.761830:0:6611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fc00/0x8c5345f1c1ec5bf2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239979.761836:0:6611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fc00/0x8c5345f1c1ec5bf2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239979.761842:0:6611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fc00/0x8c5345f1c1ec5bf2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239979.761847:0:6611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5ee29fc00 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:2.0:1782239979.761849:0:6611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fc00/0x8c5345f1c1ec5bf2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239979.761855:0:6611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fc00/0x8c5345f1c1ec5bf2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239979.761863:0:6611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bb5c55de700) 00010000:00010000:2.0:1782239979.761866:0:6611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1782239979.761869:0:6611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fc00/0x8c5345f1c1ec5bf2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239979.761874:0:6611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fc00/0x8c5345f1c1ec5bf2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239979.762183:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5c513ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+24:11584:x1868813738016384:12345-192.168.203.32@tcp:57:lhsmtool_posix.0 Request processed in 19380us (19733us total) trans 4294967513 rc 0/0 00000100:00100000:2.0:1782239979.762196:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 230 00000020:00080000:2.0:1782239979.762210:0:6611:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1782239979.762988:0:11535:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782239979.762997:0:11535:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:1.0:1782239979.764031:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738016640 00000100:00100000:1.0:1782239979.764116:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738016640 00000100:00100000:1.0:1782239979.764292:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 61 00000100:00100000:1.0:1782239979.764305:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f77a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+24:11583:x1868813738016640:12345-192.168.203.32@tcp:49:lfs.0 00000100:00100000:1.0:1782239979.764482:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f77a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+24:11583:x1868813738016640:12345-192.168.203.32@tcp:49:lfs.0 Request processed in 179us (3053us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239979.764491:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 61 00000040:00080000:3.0:1782239979.764813:0:11535:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1782239979.764844:0:11535:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1782239979.767334:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239979.767586:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738016896 00000100:00100000:1.0:1782239979.767600:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738016896 00000100:00100000:1.0:1782239979.767668:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 231 00000100:00100000:1.0:1782239979.767680:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f77a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+24:11583:x1868813738016896:12345-192.168.203.32@tcp:58:lfs.0 00000040:00080000:1.0:1782239979.768396:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:1.0:1782239979.768502:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f77a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+24:11583:x1868813738016896:12345-192.168.203.32@tcp:58:lfs.0 Request processed in 823us (1178us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239979.768512:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 231 00000100:00100000:3.0:1782239979.769431:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239979.769916:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738017152 00000100:00100000:1.0:1782239979.769928:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738017152 00000100:00100000:1.0:1782239979.769991:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 62 00000100:00100000:1.0:1782239979.770001:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5c779c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+24:11584:x1868813738017152:12345-192.168.203.32@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1782239979.771867:0:5794:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1782239979.772178:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967514 00010000:00010000:1.0:1782239979.772419:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39000/0x8c5345f1c1ec5c07 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239979.772441:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39000/0x8c5345f1c1ec5c07 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239979.772454:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39000/0x8c5345f1c1ec5c07 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239979.772463:0:5794:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39000/0x8c5345f1c1ec5c07 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239979.772470:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39000/0x8c5345f1c1ec5c07 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239979.772477:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39000/0x8c5345f1c1ec5c07 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239979.772562:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1782239979.772722:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5c779c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+26:11584:x1868813738017152:12345-192.168.203.32@tcp:35:lhsmtool_posix.0 Request processed in 2716us (3290us total) trans 4294967515 rc 0/0 00000100:00100000:1.0:1782239979.772744:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 62 00000020:00080000:1.0:1782239979.772774:0:5794:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1782239979.776738:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782239979.776930:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39000/0x8c5345f1c1ec5c07 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239979.776945:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f7e39000 already unused, calling callback (ffffffffc1728ce0) 00010000:00010000:0.0:1782239979.776951:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39000/0x8c5345f1c1ec5c07 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239979.776964:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39000/0x8c5345f1c1ec5c07 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239979.776989:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9bb5c30e4e00) 00010000:00010000:0.0:1782239979.776993:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1782239979.776999:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39000/0x8c5345f1c1ec5c07 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239979.777006:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39000/0x8c5345f1c1ec5c07 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239979.777481:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782239979.777486:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782239979.777488:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782239979.803597:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239979.803844:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738017280 00000100:00100000:0.0:1782239979.803859:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738017280 00000100:00100000:0.0:1782239979.803949:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 232 00000100:00100000:0.0:1782239979.803962:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f77a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+26:11586:x1868813738017280:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:0.0:1782239979.803998:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782239979.804026:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436400/0x8c5345f1c1ec5c0e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e835 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239979.804113:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436c00/0x8c5345f1c1ec5c15 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239979.804974:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436c00/0x8c5345f1c1ec5c15 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239979.804990:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436c00/0x8c5345f1c1ec5c15 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239979.805302:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39800/0x8c5345f1c1ec5c1c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239979.805313:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39800/0x8c5345f1c1ec5c1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239979.805322:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39800/0x8c5345f1c1ec5c1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239979.806878:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38e00/0x8c5345f1c1ec5c23 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239979.806913:0:5790:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436a00/0x8c5345f1c1ec5b2e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e7f6 expref: 27 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239979.806924:0:5790:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38e00/0x8c5345f1c1ec5c23 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239979.806979:0:5790:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436a00/0x8c5345f1c1ec5b2e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e7f6 expref: 27 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239979.806997:0:5790:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436a00/0x8c5345f1c1ec5b2e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e7f6 expref: 27 pid: 5792 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239979.807027:0:5790:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f77f1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5790:1868813758972672:192.168.203.32@tcp:104: 00000100:00100000:2.0:1782239979.807089:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782239979.807167:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782239979.807196:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f77a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1868813758972928:0@lo:400:kworker.0 00000100:00100000:0.0:1782239979.807298:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239979.807519:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758972928 00000100:00100000:0.0:1782239979.807530:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758972928 00000100:00100000:1.0:1782239979.807543:0:5790:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c1254300 going to sleep for 11 seconds 00000100:00100000:2.0:1782239979.808447:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f77a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3305:1868813758972800:0@lo:400:kworker.0 00000100:00100000:1.0:1782239979.808517:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1782239979.808521:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239979.808536:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7d0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1868813758972928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782239979.808626:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7d0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1868813758972928:12345-0@lo:400:kworker.0 Request processed in 95us (1328us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239979.808636:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1782239979.808675:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f77a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1868813758972928:0@lo:400:kworker.0 00000100:00100000:2.0:1782239979.809107:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f77a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1868813758973056:0@lo:400:kworker.0 00000100:00100000:2.0:1782239979.809689:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239979.809793:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f77a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1868813758973184:0@lo:400:kworker.0 00000100:00100000:3.0:1782239979.815071:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239979.815105:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738017536 00000100:00100000:3.0:1782239979.815118:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738017536 00000100:00100000:3.0:1782239979.815202:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 63 00000100:00100000:3.0:1782239979.815213:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f77a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+28:5564:x1868813738017536:12345-192.168.203.32@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1782239979.815554:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f77a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+29:5564:x1868813738017536:12345-192.168.203.32@tcp:35:ldlm_bl.0 Request processed in 341us (503us total) trans 4294967516 rc 0/0 00000100:00100000:3.0:1782239979.815564:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 63 00000100:00100000:3.0:1782239979.815625:0:5790:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f77f1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5790:1868813758972672:192.168.203.32@tcp:104: 00010000:00010000:3.0:1782239979.815658:0:5790:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38e00/0x8c5345f1c1ec5c23 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782239979.819319:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758973056 00000100:00100000:0.0:1782239979.819341:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758973056 00000100:00100000:0.0:1782239979.819425:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1782239979.819437:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7ce0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1868813758973056:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1782239979.819515:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782239979.819539:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239979.819543:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7ce0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1868813758973056:12345-0@lo:400:kworker.0 Request processed in 105us (9852us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239979.819553:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1782239979.819574:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758973184 00000100:00100000:0.0:1782239979.819577:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758973184 00000100:00080000:3.0:1782239979.819596:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782239979.819606:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1782239979.819614:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f77a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1868813758973184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782239979.819663:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f77a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1868813758973184:12345-0@lo:400:kworker.0 Request processed in 51us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239979.819670:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1782239979.819692:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758972800 00000100:00100000:0.0:1782239979.819696:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758972800 00000100:00100000:0.0:1782239979.819726:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1782239979.819745:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f77a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1868813758973184:0@lo:400:kworker.0 00000100:00100000:0.0:1782239979.819786:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5decbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:3305:x1868813758972800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782239979.820175:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f77a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1868813758973056:0@lo:400:kworker.0 00000100:00100000:0.0:1782239979.820374:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5decbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:3305:x1868813758972800:12345-0@lo:400:kworker.0 Request processed in 591us (11855us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239979.820382:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:2.0:1782239979.820453:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f77a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3305:1868813758972800:0@lo:400:kworker.0 00000100:00100000:3.0:1782239979.821226:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239979.821312:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738017664 00000100:00100000:2.0:1782239979.821320:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738017664 00010000:00010000:2.0:1782239979.821359:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436a00/0x8c5345f1c1ec5b2e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e7f6 expref: 29 pid: 5792 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782239979.821400:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 86 00000100:00100000:2.0:1782239979.821410:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f77a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+29:2345:x1868813738017664:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782239979.821426:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782239979.821434:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436a00/0x8c5345f1c1ec5b2e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e7f6 expref: 29 pid: 5792 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239979.821449:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436a00/0x8c5345f1c1ec5b2e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e7f6 expref: 29 pid: 5792 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239979.821478:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436a00/0x8c5345f1c1ec5b2e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e7f6 expref: 29 pid: 5792 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239979.821516:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bb5c55de700) 00010000:00010000:2.0:1782239979.821522:0:5776:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38e00/0x8c5345f1c1ec5c23 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239979.821534:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38e00/0x8c5345f1c1ec5c23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239979.821542:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38e00/0x8c5345f1c1ec5c23 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239979.821578:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782239979.821653:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f77a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+28:2345:x1868813738017664:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 244us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239979.821661:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 86 00010000:00010000:3.0:1782239979.823455:0:5790:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38e00/0x8c5345f1c1ec5c23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239979.823476:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38e00/0x8c5345f1c1ec5c23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782239979.823566:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1782239979.823572:0:5790:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782239979.823600:0:5790:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38e00/0x8c5345f1c1ec5c23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239979.823620:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38e00/0x8c5345f1c1ec5c23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239979.823632:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436c00/0x8c5345f1c1ec5c15 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239979.823638:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436c00/0x8c5345f1c1ec5c15 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239979.823646:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436c00/0x8c5345f1c1ec5c15 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239979.823652:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f4436c00 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:3.0:1782239979.823656:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436c00/0x8c5345f1c1ec5c15 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239979.823665:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436c00/0x8c5345f1c1ec5c15 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239979.823686:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bb5c30e4000) 00010000:00010000:3.0:1782239979.823689:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782239979.823694:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436c00/0x8c5345f1c1ec5c15 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239979.823700:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436c00/0x8c5345f1c1ec5c15 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239979.823731:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39800/0x8c5345f1c1ec5c1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239979.823737:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39800/0x8c5345f1c1ec5c1c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239979.823745:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39800/0x8c5345f1c1ec5c1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239979.823793:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f7e39800 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:3.0:1782239979.823797:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39800/0x8c5345f1c1ec5c1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239979.823803:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39800/0x8c5345f1c1ec5c1c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239979.823812:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bb5c30e4200) 00010000:00010000:3.0:1782239979.823815:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782239979.823819:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39800/0x8c5345f1c1ec5c1c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239979.823825:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39800/0x8c5345f1c1ec5c1c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239979.823883:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436400/0x8c5345f1c1ec5c0e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e835 expref: 28 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239979.824072:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38e00/0x8c5345f1c1ec5c23 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e835 expref: 27 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239979.824093:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bb5c55de700) 00010000:00010000:3.0:1782239979.824095:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782239979.824098:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5f7e38e00, rc 0) 00000100:00100000:3.0:1782239979.824246:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f77a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+27:11586:x1868813738017280:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 20285us (20662us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239979.824257:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 232 00000100:00100000:3.0:1782239980.319503:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782239980.319543:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f77a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813758973312:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782239980.319653:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239980.319772:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758973312 00000100:00100000:3.0:1782239980.319782:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758973312 00000100:00100000:3.0:1782239980.319850:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1782239980.319872:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f77a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3305:x1868813758973312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782239980.319931:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782239980.319987:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f77a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3305:x1868813758973312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 127us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239980.319996:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:3.0:1782239980.320022:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782239980.320071:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f77a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813758973312:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782239980.770420:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1782239980.771622:0:11535:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1782239980.771630:0:11535:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1782239980.771673:0:11535:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1782239980.771686:0:11535:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1782239980.771873:0:11535:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f77f1880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11535:1868813758973440:192.168.203.32@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1782239980.772003:0:11535:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5dac4f3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782239980.777073:0:11535:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f77f1880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11535:1868813758973440:192.168.203.32@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1782239980.783344:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239980.783480:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738017792 00000100:00100000:2.0:1782239980.783492:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738017792 00000100:00100000:2.0:1782239980.783582:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 233 00000100:00100000:2.0:1782239980.783595:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f77f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+27:11597:x1868813738017792:12345-192.168.203.32@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1782239980.783640:0:5792:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00080000:1.0:1782239980.784341:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782239980.784575:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f77f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+27:11597:x1868813738017792:12345-192.168.203.32@tcp:53:lhsmtool_posix.0 Request processed in 978us (1241us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239980.784587:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 233 00000100:00100000:0.0:1782239980.801906:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239980.802097:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738018048 00000100:00100000:2.0:1782239980.802110:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738018048 00000100:00100000:2.0:1782239980.802188:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 234 00000100:00100000:2.0:1782239980.802200:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7d0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+27:11597:x1868813738018048:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782239980.802237:0:6611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782239980.802273:0:6611:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e200/0x8c5345f1c1ec5c2a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e83c expref: -99 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239980.802410:0:6611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fe00/0x8c5345f1c1ec5c31 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239980.802427:0:6611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fe00/0x8c5345f1c1ec5c31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239980.802442:0:6611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fe00/0x8c5345f1c1ec5c31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782239980.802455:0:6611:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1782239980.802626:0:6611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e200/0x8c5345f1c1ec5c2a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e83c expref: 30 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239980.802647:0:6611:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fe00/0x8c5345f1c1ec5c31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e83c expref: 29 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239980.802658:0:6611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bb5c55de700) 00010000:00010000:2.0:1782239980.802661:0:6611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782239980.802666:0:6611:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5ee29fe00, rc 0) 00000100:00100000:2.0:1782239980.803440:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7d0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+29:11597:x1868813738018048:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 1236us (1554us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1782239980.803452:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 234 00000100:00100000:0.0:1782239980.813009:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239980.813114:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738018176 00000100:00100000:1.0:1782239980.813128:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738018176 00000100:00100000:1.0:1782239980.813206:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 16 00000100:00100000:1.0:1782239980.813217:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7d0e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+29:2345:x1868813738018176:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782239980.813240:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782239980.813272:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29fe00/0x8c5345f1c1ec5c31 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e83c expref: 29 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239980.813293:0:5775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bb5c55de700) 00010000:00010000:1.0:1782239980.813299:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782239980.813376:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7d0e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+28:2345:x1868813738018176:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 160us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239980.813385:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 16 00000100:00100000:0.0:1782239980.819697:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239980.819874:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738018432 00000100:00100000:0.0:1782239980.819887:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738018432 00000100:00100000:0.0:1782239980.819962:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 235 00000100:00100000:0.0:1782239980.819975:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7d0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+28:11597:x1868813738018432:12345-192.168.203.32@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1782239980.820085:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437200/0x8c5345f1c1ec5c3f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239980.820110:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437200/0x8c5345f1c1ec5c3f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239980.820124:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437200/0x8c5345f1c1ec5c3f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239980.820404:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437200/0x8c5345f1c1ec5c3f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239980.820414:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437200/0x8c5345f1c1ec5c3f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239980.820421:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437200/0x8c5345f1c1ec5c3f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239980.820427:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f4437200 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:0.0:1782239980.820442:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437200/0x8c5345f1c1ec5c3f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239980.820451:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437200/0x8c5345f1c1ec5c3f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239980.820466:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bb5c55de700) 00010000:00010000:0.0:1782239980.820469:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1782239980.820475:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437200/0x8c5345f1c1ec5c3f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239980.820482:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437200/0x8c5345f1c1ec5c3f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782239980.820678:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7d0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+29:11597:x1868813738018432:12345-192.168.203.32@tcp:57:lhsmtool_posix.0 Request processed in 704us (991us total) trans 4294967518 rc 0/0 00000100:00100000:0.0:1782239980.820689:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 235 00000040:00080000:1.0:1782239980.820902:0:11535:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1782239980.820908:0:11535:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1782239980.821414:0:11535:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1782239980.821429:0:11535:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1782239980.825325:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239980.825415:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738018688 00000100:00100000:1.0:1782239980.825429:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738018688 00000100:00100000:1.0:1782239980.825515:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 64 00000100:00100000:1.0:1782239980.825528:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7d0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+29:11597:x1868813738018688:12345-192.168.203.32@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1782239980.825880:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7d0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+30:11597:x1868813738018688:12345-192.168.203.32@tcp:35:lhsmtool_posix.0 Request processed in 354us (572us total) trans 4294967519 rc 0/0 00000100:00100000:1.0:1782239980.825889:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 64 00000040:00080000:2.0:1782239980.986205:0:12315:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1782239980.986219:0:12315:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1782239980.986269:0:12315:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1782239980.986285:0:12315:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1782239981.216955:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239981.217603:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738018944 00000100:00100000:1.0:1782239981.217613:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738018944 00000100:00100000:1.0:1782239981.217667:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 236 00000100:00100000:1.0:1782239981.217678:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7812a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+30:11610:x1868813738018944:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:1.0:1782239981.217701:0:6611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782239981.217721:0:6611:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38800/0x8c5345f1c1ec5c46 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e843 expref: -99 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239981.219481:0:6611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38a00/0x8c5345f1c1ec5c4d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239981.219502:0:6611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38a00/0x8c5345f1c1ec5c4d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239981.219534:0:6611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38a00/0x8c5345f1c1ec5c4d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782239981.219548:0:6611:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1782239981.219689:0:6611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38800/0x8c5345f1c1ec5c46 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e843 expref: 33 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239981.219708:0:6611:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38a00/0x8c5345f1c1ec5c4d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e843 expref: 32 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239981.219717:0:6611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bb5c55de700) 00010000:00010000:1.0:1782239981.219720:0:6611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1782239981.219723:0:6611:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5f7e38a00, rc 0) 00000100:00100000:1.0:1782239981.219811:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7812a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+32:11610:x1868813738018944:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 2135us (2862us total) trans 4294967520 rc 0/0 00000100:00100000:1.0:1782239981.219821:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 236 00000100:00100000:3.0:1782239981.229033:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239981.229116:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738019072 00000100:00100000:1.0:1782239981.229126:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738019072 00000100:00100000:1.0:1782239981.229200:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 237 00000100:00100000:1.0:1782239981.229213:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f77a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+32:11610:x1868813738019072:12345-192.168.203.32@tcp:54:lfs.0 00010000:00010000:1.0:1782239981.229291:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38400/0x8c5345f1c1ec5c5b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239981.229309:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38400/0x8c5345f1c1ec5c5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239981.229321:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38400/0x8c5345f1c1ec5c5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239981.229365:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38400/0x8c5345f1c1ec5c5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239981.229373:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38400/0x8c5345f1c1ec5c5b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239981.229387:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38400/0x8c5345f1c1ec5c5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239981.229394:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f7e38400 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:1.0:1782239981.229398:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38400/0x8c5345f1c1ec5c5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239981.229405:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38400/0x8c5345f1c1ec5c5b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239981.229418:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bb5c55de700) 00010000:00010000:1.0:1782239981.229421:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782239981.229426:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38400/0x8c5345f1c1ec5c5b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239981.229432:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38400/0x8c5345f1c1ec5c5b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782239981.229506:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f77a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+32:11610:x1868813738019072:12345-192.168.203.32@tcp:54:lfs.0 Request processed in 296us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239981.229514:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 237 00000100:00100000:3.0:1782239981.355698:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239981.356056:0:8312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738019200 00000100:00100000:1.0:1782239981.356066:0:8312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738019200 00000100:00100000:1.0:1782239981.356193:0:8312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 71 00000100:00100000:1.0:1782239981.356222:0:8312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f77a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+7:2346:x1868813738019200:12345-192.168.203.32@tcp:101:cat.0 00010000:00010000:1.0:1782239981.356242:0:8312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782239981.356273:0:8312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e90035c2/0x8c5345f1c1ec5c62 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e84a expref: -99 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782239981.356300:0:8312:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a3ad2ea, atime: 0x6a3ad2ea, ctime: 0x6a3ad2ea, blocks: 0xb 00010000:00010000:1.0:1782239981.356319:0:8312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=360s v=(0 0) 00010000:00010000:1.0:1782239981.356324:0:8312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782239981.356335:0:8312:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e90035c2/0x8c5345f1c1ec5c62 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e84a expref: 8 pid: 8312 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239981.356355:0:8312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e90035c2/0x8c5345f1c1ec5c62 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e84a expref: 8 pid: 8312 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239981.356377:0:8312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5f7e38400, rc 0) 00000100:00100000:1.0:1782239981.356444:0:8312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f77a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+8:2346:x1868813738019200:12345-192.168.203.32@tcp:101:cat.0 Request processed in 225us (752us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239981.356451:0:8312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 71 00000100:00080000:3.0:1782239981.360703:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782239981.363150:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239981.365071:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738019328 00000100:00100000:1.0:1782239981.365083:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738019328 00002000:00100000:1.0:1782239981.365136:0:6594:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff9bb5f7811500 x1868813738019328/t0(0) o3->36dd742b-25b8-431e-bf41-75f2fff47ffb@192.168.203.32@tcp:582/0 lens 488/0 e 0 to 0 dl 1782239992 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1782239981.365147:0:6594:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9bb5f7811500 with x1868813738019328 ext(0->4095) 00002000:00010000:1.0:1782239981.365153:0:6594:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bb5f7811500 00000100:00100000:1.0:1782239981.365217:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 7 00000100:00100000:1.0:1782239981.365227:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7811500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+8:2345:x1868813738019328:12345-192.168.203.32@tcp:3:cat.0 00000100:00100000:1.0:1782239981.366151:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7811500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+8:2345:x1868813738019328:12345-192.168.203.32@tcp:3:cat.0 Request processed in 922us (3006us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1782239981.366161:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 7 00002000:00100000:1.0:1782239981.366170:0:6594:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff9bb5f7811500 x1868813738019328/t0(0) o3->36dd742b-25b8-431e-bf41-75f2fff47ffb@192.168.203.32@tcp:582/0 lens 488/4536 e 0 to 0 dl 1782239992 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1782239981.366179:0:6594:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9bb5f7811500 with x1868813738019328 ext(0->4095) 00002000:00010000:1.0:1782239981.366183:0:6594:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bb5f7811500 00000001:00080000:2.0:1782239981.397683:0:7493:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:2.0:1782239981.397929:0:7493:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:2.0:1782239981.398137:0:7493:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00010000:00010000:1.0:1782239981.791120:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782239982.822104:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782239983.840575:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782239983.903292:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782239983.903316:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5ded65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1868813758973568:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782239983.903394:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239983.903576:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758973568 00000100:00100000:1.0:1782239983.903584:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758973568 00000100:00100000:1.0:1782239983.903653:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1782239983.903662:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc298700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1868813758973568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782239983.903709:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782239983.903780:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc298700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1868813758973568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239983.903787:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:0.0:1782239983.904113:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782239983.904151:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5ded65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1868813758973568:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782239984.666077:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239984.666114:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239984.666148:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239984.666168:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239984.666193:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239984.666219:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738019840 00000100:00100000:2.0:1782239984.666229:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738019840 00000100:00100000:2.0:1782239984.666288:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738019712 00000100:00100000:2.0:1782239984.666292:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738019712 00000100:00100000:3.0:1782239984.666311:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738019584 00000100:00100000:3.0:1782239984.666317:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738019584 00000100:00100000:2.0:1782239984.666322:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 97 00000100:00100000:2.0:1782239984.666334:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ded64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+5:2344:x1868813738019840:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:3.0:1782239984.666354:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738019968 00000100:00100000:3.0:1782239984.666368:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738019968 00000100:00100000:3.0:1782239984.666403:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 170 00000100:00100000:2.0:1782239984.666409:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ded64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+5:2344:x1868813738019840:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 76us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239984.666416:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ded67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+32:2344:x1868813738019584:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:2.0:1782239984.666424:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 97 00000100:00100000:2.0:1782239984.666446:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 98 00000100:00100000:2.0:1782239984.666455:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ded67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+8:2344:x1868813738019712:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:3.0:1782239984.666470:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ded67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36dd742b-25b8-431e-bf41-75f2fff47ffb+32:2344:x1868813738019584:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 57us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239984.666479:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 170 00000100:00100000:2.0:1782239984.666491:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ded67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+8:2344:x1868813738019712:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 36us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239984.666497:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 171 00000100:00100000:2.0:1782239984.666504:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 98 00000100:00100000:3.0:1782239984.666510:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ded65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f135cc01-3d42-4f2a-80ff-79724f1d3285+5:2344:x1868813738019968:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:2.0:1782239984.666530:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738019456 00000100:00100000:2.0:1782239984.666535:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738019456 00000100:00100000:3.0:1782239984.666541:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ded65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f135cc01-3d42-4f2a-80ff-79724f1d3285+5:2344:x1868813738019968:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 35us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239984.666551:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 171 00000100:00100000:2.0:1782239984.666918:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 300 00000100:00100000:2.0:1782239984.666926:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5decbc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afaefb1a-536b-42a3-a3ff-47200f8611c3+13:2344:x1868813738019456:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:2.0:1782239984.666957:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5decbc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afaefb1a-536b-42a3-a3ff-47200f8611c3+13:2344:x1868813738019456:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 32us (809us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239984.666963:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 300 00000100:00080000:2.0:1782239984.667155:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782239984.667160:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782239984.667163:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1782239984.872386:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782239984.928295:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f77a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1868813758973824:0@lo:400:kworker.0 00000100:00100000:3.0:1782239984.928364:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239984.928412:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f77a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1868813758974336:0@lo:400:kworker.0 00000100:00100000:3.0:1782239984.928438:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239984.928466:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1782239984.928472:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f77a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3307:1868813758973696:0@lo:400:kworker.0 00000100:00100000:3.0:1782239984.928499:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239984.928519:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f77a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1868813758974208:0@lo:400:kworker.0 00000100:00100000:3.0:1782239984.928539:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239984.928563:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f77a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1868813758973952:0@lo:400:kworker.0 00000100:00100000:3.0:1782239984.928608:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239984.928627:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782239984.928632:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f77a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1868813758974080:0@lo:400:kworker.0 00000100:00100000:3.0:1782239984.928662:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239984.928709:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758973824 00000100:00100000:3.0:1782239984.928716:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758973824 00000040:00080000:1.0:1782239984.931286:0:11535:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1782239984.931295:0:11535:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1782239984.931330:0:11535:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1782239984.931337:0:11535:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1782239984.932017:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758974336 00000100:00100000:1.0:1782239984.932028:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758974336 00000100:00100000:1.0:1782239984.932144:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758974080 00000100:00100000:1.0:1782239984.932148:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758974080 00000100:00100000:1.0:1782239984.932182:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1782239984.932190:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f77a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1868813758974336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782239984.932277:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f77a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1868813758974336:12345-0@lo:400:kworker.0 Request processed in 87us (3838us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239984.932285:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1782239984.932301:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1782239984.932307:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f4895f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3304:x1868813758974080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782239984.932342:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f4895f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3304:x1868813758974080:12345-0@lo:400:kworker.0 Request processed in 35us (3679us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239984.932348:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1782239984.932479:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758974208 00000100:00100000:3.0:1782239984.932485:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758974208 00000100:00100000:2.0:1782239984.932828:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758973952 00000100:00100000:2.0:1782239984.932833:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758973952 00000100:00100000:2.0:1782239984.937622:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1782239984.937656:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f77a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1868813758973824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782239984.937766:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f77a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1868813758973824:12345-0@lo:400:kworker.0 Request processed in 128us (9403us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239984.937775:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1782239984.937805:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1782239984.937812:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f77a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1868813758974208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782239984.937839:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f77a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1868813758974208:12345-0@lo:400:kworker.0 Request processed in 28us (9299us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239984.937845:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1782239984.937855:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1782239984.937879:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f4896d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1868813758973952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782239984.937911:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f4896d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1868813758973952:12345-0@lo:400:kworker.0 Request processed in 50us (9303us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239984.937917:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00080000:2.0:1782239984.937976:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782239984.937994:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782239984.947301:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758973696 00000100:00100000:1.0:1782239984.947316:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758973696 00000100:00100000:1.0:1782239984.947367:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1782239984.947376:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5decbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:3307:x1868813758973696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782239984.947454:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5decbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:3307:x1868813758973696:12345-0@lo:400:kworker.0 Request processed in 79us (18954us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239984.947461:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1782239984.948826:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f77a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3307:1868813758973696:0@lo:400:kworker.0 00000100:00100000:0.0:1782239984.948843:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f77a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1868813758974208:0@lo:400:kworker.0 00000100:00100000:0.0:1782239984.948855:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f77a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1868813758973824:0@lo:400:kworker.0 00000100:00100000:0.0:1782239984.948889:0:3307:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1782239984.948903:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bb5eddf6d80, transno 4294967307 00000004:00080000:0.0:1782239984.948915:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:0.0:1782239984.948935:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bb5e8eeca80, transno 4294967310 00000100:00100000:0.0:1782239984.948940:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f77a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1868813758974336:0@lo:400:kworker.0 00000100:00100000:1.0:1782239984.950260:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f77a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1868813758974080:0@lo:400:kworker.0 00000100:00100000:1.0:1782239984.950707:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f77a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1868813758973952:0@lo:400:kworker.0 00000001:00080000:1.0:1782239985.028286:0:6614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:1.0:1782239985.028304:0:6614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:0.0:1782239985.065791:0:5812:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967518 is committed 00000001:00080000:0.0:1782239985.065813:0:5812:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:0.0:1782239985.065857:0:5812:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bb5e8e80480 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:0.0:1782239985.065882:0:5812:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9bb5dec4b500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bb5e8e80300 00000020:00080000:0.0:1782239985.065886:0:5812:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9bb5dec4b300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bb5f7c8d000 00000020:00080000:0.0:1782239985.065906:0:5812:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:0.0:1782239985.065951:0:5823:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:0.0:1782239985.066317:0:5823:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:0.0:1782239985.439114:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782239985.439136:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f4895880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813758974464:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782239985.439207:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239985.439364:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758974464 00000100:00100000:3.0:1782239985.439372:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758974464 00000100:00100000:3.0:1782239985.439415:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1782239985.439423:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc299f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1868813758974464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782239985.439457:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782239985.439507:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc299f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1868813758974464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239985.439514:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1782239985.439601:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f4895880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813758974464:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782239985.887062:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782239986.914296:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782239987.474978:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239987.475886:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738020096 00000100:00100000:1.0:1782239987.475897:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738020096 00000100:00080000:2.0:1782239987.475966:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782239987.475969:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 238 00000100:00100000:1.0:1782239987.475980:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ded65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+19:11271:x1868813738020096:12345-192.168.203.32@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1782239987.476102:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ded65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+19:11271:x1868813738020096:12345-192.168.203.32@tcp:60:lhsmtool_posix.0 Request processed in 124us (1134us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239987.476110:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 238 00000100:00100000:2.0:1782239987.482881:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239987.483010:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738020352 00000100:00100000:0.0:1782239987.483020:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738020352 00000100:00100000:0.0:1782239987.483079:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 65 00000100:00100000:0.0:1782239987.483088:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fbe08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+19:11271:x1868813738020352:12345-192.168.203.32@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1782239987.483650:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fbe08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+20:11271:x1868813738020352:12345-192.168.203.32@tcp:35:lhsmtool_posix.0 Request processed in 560us (775us total) trans 4294967521 rc 0/0 00000100:00100000:0.0:1782239987.483668:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 65 00000100:00100000:3.0:1782239987.759359:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239987.760127:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738020480 00000100:00100000:0.0:1782239987.760154:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738020480 00000100:00100000:0.0:1782239987.760235:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 239 00000100:00100000:0.0:1782239987.760246:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f4897480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f135cc01-3d42-4f2a-80ff-79724f1d3285+5:12062:x1868813738020480:12345-192.168.203.32@tcp:101:lsof.0 00010000:00010000:0.0:1782239987.760266:0:6611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782239987.760286:0:6611:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437400/0x8c5345f1c1ec5c69 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e851 expref: -99 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239987.760352:0:6611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436000/0x8c5345f1c1ec5c70 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239987.760366:0:6611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436000/0x8c5345f1c1ec5c70 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239987.760378:0:6611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436000/0x8c5345f1c1ec5c70 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782239987.760572:0:6611:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1782239987.760577:0:6611:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1782239987.760656:0:6611:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436000/0x8c5345f1c1ec5c70 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239987.760682:0:6611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4437400/0x8c5345f1c1ec5c69 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e851 expref: 7 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239987.760700:0:6611:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436000/0x8c5345f1c1ec5c70 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e851 expref: 6 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239987.760710:0:6611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bb5c55de500) 00010000:00010000:0.0:1782239987.760713:0:6611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782239987.760716:0:6611:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5f4436000, rc 0) 00000100:00100000:0.0:1782239987.760860:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f4897480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f135cc01-3d42-4f2a-80ff-79724f1d3285+6:12062:x1868813738020480:12345-192.168.203.32@tcp:101:lsof.0 Request processed in 615us (1511us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239987.760868:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 239 00000100:00080000:2.0:1782239987.761227:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1782239987.934988:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782239988.959671:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782239989.023116:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782239989.023141:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fbe09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1868813758974592:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782239989.023208:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239989.023292:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758974592 00000100:00100000:3.0:1782239989.023300:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758974592 00000100:00080000:2.0:1782239989.023350:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782239989.023380:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1782239989.023389:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f77f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1868813758974592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782239989.023424:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782239989.023491:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f77f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1868813758974592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239989.023499:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1782239989.025004:0:3304:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:1.0:1782239989.025017:0:3304:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bb5fc08d880, transno 4294967322 00000004:00080000:1.0:1782239989.025043:0:3304:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:1.0:1782239989.025077:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fbe09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1868813758974592:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782239989.781172:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239989.781233:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239989.781276:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239989.781313:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239989.781337:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738020608 00000100:00100000:1.0:1782239989.781351:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738020608 00000100:00100000:2.0:1782239989.781358:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239989.781399:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738020864 00000100:00100000:2.0:1782239989.781408:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738020864 00000100:00100000:1.0:1782239989.781441:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 302 00000100:00100000:1.0:1782239989.781463:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5decbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afaefb1a-536b-42a3-a3ff-47200f8611c3+13:2344:x1868813738020608:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:2.0:1782239989.781474:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738020992 00000100:00100000:2.0:1782239989.781481:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738020992 00000100:00100000:2.0:1782239989.781512:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 101 00000100:00100000:2.0:1782239989.781523:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fbe0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+7:2344:x1868813738020864:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:2.0:1782239989.781605:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fbe0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+7:2344:x1868813738020864:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 83us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239989.781614:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 101 00000100:00100000:2.0:1782239989.781634:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 102 00000100:00100000:2.0:1782239989.781641:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fbe0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+5:2344:x1868813738020992:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:2.0:1782239989.781667:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fbe0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+5:2344:x1868813738020992:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 26us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239989.781673:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 102 00000100:00080000:2.0:1782239989.781694:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782239989.781699:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782239989.781743:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738021120 00000100:00100000:2.0:1782239989.781806:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738021120 00000100:00100000:2.0:1782239989.781858:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738020736 00000100:00100000:2.0:1782239989.781863:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738020736 00000100:00100000:1.0:1782239989.781870:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5decbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afaefb1a-536b-42a3-a3ff-47200f8611c3+13:2344:x1868813738020608:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 411us (707us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239989.781881:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 302 00000100:00100000:2.0:1782239989.781894:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 175 00000100:00100000:2.0:1782239989.781907:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fbe09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f135cc01-3d42-4f2a-80ff-79724f1d3285+6:2344:x1868813738021120:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:2.0:1782239989.781956:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fbe09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f135cc01-3d42-4f2a-80ff-79724f1d3285+6:2344:x1868813738021120:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 52us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239989.781964:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 175 00000100:00100000:2.0:1782239989.781980:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 176 00000100:00100000:2.0:1782239989.781986:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fbe09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+20:2344:x1868813738020736:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:2.0:1782239989.782021:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fbe09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+20:2344:x1868813738020736:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 35us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239989.782028:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 176 00000100:00080000:2.0:1782239989.782045:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1782239989.983088:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782239990.047116:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f4894380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1868813758974848:0@lo:400:kworker.0 00000100:00100000:3.0:1782239990.047134:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f4894700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813758975104:0@lo:400:kworker.0 00000100:00100000:1.0:1782239990.047333:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f4894a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1868813758974976:0@lo:400:kworker.0 00000100:00100000:2.0:1782239990.047397:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f4896a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3306:1868813758974720:0@lo:400:kworker.0 00000100:00100000:3.0:1782239990.054600:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239990.058855:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758975104 00000100:00100000:3.0:1782239990.058876:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758975104 00000100:00100000:3.0:1782239990.058957:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1782239990.058971:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f4894e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1868813758975104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782239990.059051:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239990.059103:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f4895500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1868813758975360:0@lo:400:kworker.0 00000100:00100000:1.0:1782239990.059403:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239990.060099:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239990.060952:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758974848 00000100:00100000:0.0:1782239990.060964:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758974848 00000100:00100000:0.0:1782239990.061012:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1782239990.061023:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8eeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1868813758974848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782239990.061094:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8eeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1868813758974848:12345-0@lo:400:kworker.0 Request processed in 74us (2051us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239990.061101:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1782239990.061117:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758974976 00000100:00100000:0.0:1782239990.061120:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758974976 00000100:00100000:3.0:1782239990.061452:0:8312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758975360 00000100:00100000:3.0:1782239990.061462:0:8312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758975360 00000100:00100000:0.0:1782239990.061539:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1782239990.061548:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7ce0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1868813758974976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782239990.061590:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7ce0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1868813758974976:12345-0@lo:400:kworker.0 Request processed in 44us (2189us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239990.061596:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00080000:0.0:1782239990.066849:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782239990.066979:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f4894a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1868813758974976:0@lo:400:kworker.0 00000100:00100000:2.0:1782239990.068938:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782239990.069032:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f4896300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1868813758975232:0@lo:400:kworker.0 00000100:00100000:0.0:1782239990.070542:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f4894380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1868813758974848:0@lo:400:kworker.0 00000100:00080000:0.0:1782239990.070594:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782239990.070801:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758974720 00000100:00100000:0.0:1782239990.070857:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758974720 00000100:00100000:0.0:1782239990.070924:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1782239990.070934:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5decbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:3306:x1868813758974720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782239990.071969:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239990.072393:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5decbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:3306:x1868813758974720:12345-0@lo:400:kworker.0 Request processed in 114us (2117us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239990.072407:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1782239990.072479:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758975232 00000100:00100000:0.0:1782239990.072487:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758975232 00000100:00100000:0.0:1782239990.072543:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1782239990.072551:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fbe0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1868813758975232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782239990.074012:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fbe0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1868813758975232:12345-0@lo:400:kworker.0 Request processed in 1452us (2036us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239990.074028:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1782239990.074368:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f4896300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1868813758975232:0@lo:400:kworker.0 00000100:00100000:2.0:1782239990.074403:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f4896a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3306:1868813758974720:0@lo:400:kworker.0 00000100:00100000:2.0:1782239990.074501:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f4894e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1868813758975104:12345-0@lo:400:kworker.0 Request processed in 15533us (19913us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239990.074511:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1782239990.074551:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f4894700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813758975104:0@lo:400:kworker.0 00000100:00080000:2.0:1782239990.074862:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782239990.078704:0:8312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1782239990.078729:0:8312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f77a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1868813758975360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782239990.078912:0:8312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f77a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1868813758975360:12345-0@lo:400:kworker.0 Request processed in 193us (19166us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239990.078920:0:8312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1782239990.078993:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f4895500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1868813758975360:0@lo:400:kworker.0 00000001:00080000:1.0:1782239990.155441:0:5812:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:1.0:1782239990.155468:0:5812:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:2.0:1782239990.155820:0:5823:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:2.0:1782239990.155843:0:5823:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:0.0:1782239990.559999:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f4895500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1868813758975488:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782239990.560116:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239990.562143:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758975488 00000100:00100000:3.0:1782239990.562162:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758975488 00000100:00100000:3.0:1782239990.562263:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1782239990.562275:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f77a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1868813758975488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782239990.562346:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782239990.562449:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f77a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1868813758975488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 176us (2332us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239990.562457:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1782239990.562949:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f4895500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1868813758975488:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782239991.007968:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782239992.031170:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1782239992.064475:0:12518:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 14:39:49 (1782239989) 00010000:00010000:1.0:1782239993.058159:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782239994.084191:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1782239994.146911:0:11535:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1782239994.146926:0:11535:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1782239994.147446:0:11535:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:1.0:1782239994.147455:0:11535:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1782239994.148106:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f4897b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813758975616:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782239994.148197:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239994.149065:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758975616 00000100:00100000:3.0:1782239994.149076:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758975616 00000100:00100000:3.0:1782239994.149147:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1782239994.149159:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7c0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1868813758975616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782239994.149205:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782239994.149276:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7c0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1868813758975616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (1078us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239994.149283:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1782239994.149414:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f4897b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813758975616:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1782239994.150022:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782239994.900681:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239994.900724:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239994.900864:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738021504 00000100:00100000:0.0:1782239994.900873:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738021504 00000100:00100000:0.0:1782239994.900943:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 105 00000100:00100000:0.0:1782239994.900954:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f4897100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+7:2347:x1868813738021504:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:0.0:1782239994.901023:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f4897100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+7:2347:x1868813738021504:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 70us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239994.901031:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 105 00000100:00080000:0.0:1782239994.901054:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782239994.901175:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239994.901282:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239994.901321:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239994.901341:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738021760 00000100:00100000:3.0:1782239994.901344:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738021760 00000100:00100000:3.0:1782239994.901372:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738021376 00000100:00100000:3.0:1782239994.901375:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738021376 00000100:00100000:3.0:1782239994.901390:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 180 00000100:00100000:3.0:1782239994.901396:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f4896680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f135cc01-3d42-4f2a-80ff-79724f1d3285+6:2347:x1868813738021760:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:3.0:1782239994.901428:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f4896680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f135cc01-3d42-4f2a-80ff-79724f1d3285+6:2347:x1868813738021760:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 31us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239994.901434:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 180 00000100:00100000:3.0:1782239994.901446:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 181 00000100:00100000:3.0:1782239994.901451:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f4895c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+19:2347:x1868813738021376:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:3.0:1782239994.901470:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f4895c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+19:2347:x1868813738021376:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 19us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239994.901476:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 181 00000100:00080000:3.0:1782239994.901488:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782239994.901635:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738021248 00000100:00100000:2.0:1782239994.901639:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738021248 00000100:00100000:2.0:1782239994.901673:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 304 00000100:00100000:2.0:1782239994.901679:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5decbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afaefb1a-536b-42a3-a3ff-47200f8611c3+13:2347:x1868813738021248:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:2.0:1782239994.901715:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5decbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afaefb1a-536b-42a3-a3ff-47200f8611c3+13:2347:x1868813738021248:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 36us (1044us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239994.901722:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 304 00000100:00100000:2.0:1782239994.902015:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738021632 00000100:00100000:2.0:1782239994.902020:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738021632 00000100:00080000:3.0:1782239994.905192:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782239994.905737:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 106 00000100:00100000:2.0:1782239994.905784:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f4897800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+5:2347:x1868813738021632:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:2.0:1782239994.905883:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f4897800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:36dd742b-25b8-431e-bf41-75f2fff47ffb+5:2347:x1868813738021632:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 134us (4560us total) trans 0 rc 0/0 00000100:00100000:2.0:1782239994.905891:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 106 00010000:00010000:1.0:1782239995.102995:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782239995.168457:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f77a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1868813758976000:0@lo:400:kworker.0 00000100:00100000:0.0:1782239995.168535:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239995.168602:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782239995.168608:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f77a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1868813758976128:0@lo:400:kworker.0 00000100:00100000:0.0:1782239995.168634:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782239995.168667:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758976128 00000100:00100000:0.0:1782239995.168673:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758976128 00000100:00100000:0.0:1782239995.168714:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1782239995.168722:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5eddf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1868813758976128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782239995.168806:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5eddf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1868813758976128:12345-0@lo:400:kworker.0 Request processed in 84us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239995.168813:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1782239995.168856:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f77a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1868813758976128:0@lo:400:kworker.0 00000100:00100000:3.0:1782239995.169182:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f77a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1868813758975872:0@lo:400:kworker.0 00000100:00100000:3.0:1782239995.169215:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239995.169241:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb601359c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1868813758976384:0@lo:400:kworker.0 00000100:00100000:3.0:1782239995.169263:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239995.169281:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1782239995.169295:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f77a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3307:1868813758975744:0@lo:400:kworker.0 00000100:00100000:3.0:1782239995.169322:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239995.169353:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5c513e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1868813758976256:0@lo:400:kworker.0 00000100:00100000:3.0:1782239995.169375:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239995.169401:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758976000 00000100:00100000:3.0:1782239995.169405:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758976000 00000100:00100000:3.0:1782239995.169435:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758975872 00000100:00100000:3.0:1782239995.169438:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758975872 00000100:00100000:3.0:1782239995.169448:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758976256 00000100:00100000:3.0:1782239995.169450:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758976256 00000100:00100000:3.0:1782239995.169461:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1782239995.169466:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb60135bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1868813758976000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782239995.169500:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb60135bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1868813758976000:12345-0@lo:400:kworker.0 Request processed in 33us (975us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239995.169507:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1782239995.169518:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1782239995.169524:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f4894000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1868813758975872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782239995.169568:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f4894000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1868813758975872:12345-0@lo:400:kworker.0 Request processed in 43us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239995.169573:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1782239995.169584:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00080000:1.0:1782239995.169587:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782239995.169590:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f4897b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1868813758976256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782239995.169601:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758976384 00000100:00100000:1.0:1782239995.169605:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758976384 00000100:00100000:3.0:1782239995.169614:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f4897b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1868813758976256:12345-0@lo:400:kworker.0 Request processed in 25us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239995.169620:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1782239995.169632:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1782239995.169638:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f4895180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1868813758976384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782239995.169643:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5c513e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1868813758976256:0@lo:400:kworker.0 00000100:00100000:3.0:1782239995.169662:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f77a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1868813758975872:0@lo:400:kworker.0 00000100:00100000:1.0:1782239995.169669:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f4895180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1868813758976384:12345-0@lo:400:kworker.0 Request processed in 33us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239995.169671:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb601359c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1868813758976384:0@lo:400:kworker.0 00000100:00100000:1.0:1782239995.169675:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:1.0:1782239995.169689:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782239995.169701:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f77a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1868813758976000:0@lo:400:kworker.0 00000100:00100000:0.0:1782239995.170091:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758975744 00000100:00100000:0.0:1782239995.170096:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758975744 00000100:00100000:0.0:1782239995.170127:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1782239995.170134:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5decbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:3307:x1868813758975744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782239995.170171:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5decbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:3307:x1868813758975744:12345-0@lo:400:kworker.0 Request processed in 37us (848us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239995.170177:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1782239995.172125:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f77a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3307:1868813758975744:0@lo:400:kworker.0 00000100:00100000:0.0:1782239995.679771:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f4895500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1868813758976512:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782239995.679856:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782239995.680322:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758976512 00000100:00100000:3.0:1782239995.680330:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758976512 00000100:00100000:3.0:1782239995.680379:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1782239995.680388:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5eddf5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1868813758976512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782239995.680422:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782239995.680476:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5eddf5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1868813758976512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239995.680483:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1782239995.680606:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f4895500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1868813758976512:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782239996.127454:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782239996.465909:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239996.466344:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738022016 00000100:00100000:1.0:1782239996.466365:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738022016 00000100:00100000:1.0:1782239996.466444:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 66 00000100:00100000:1.0:1782239996.466455:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5eddf5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+19:12283:x1868813738022016:12345-192.168.203.32@tcp:35:umount.0 00000100:00100000:1.0:1782239996.467027:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5eddf5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+20:12283:x1868813738022016:12345-192.168.203.32@tcp:35:umount.0 Request processed in 572us (1125us total) trans 4294967522 rc 0/0 00000100:00100000:1.0:1782239996.467036:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 66 00000100:00080000:2.0:1782239996.467553:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782239996.469152:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239996.469935:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738022272 00000100:00100000:1.0:1782239996.469944:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738022272 00000100:00100000:1.0:1782239996.470000:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 67 00000100:00100000:1.0:1782239996.470010:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f4894700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+20:12283:x1868813738022272:12345-192.168.203.32@tcp:35:umount.0 00000100:00100000:1.0:1782239996.471000:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f4894700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+21:12283:x1868813738022272:12345-192.168.203.32@tcp:35:umount.0 Request processed in 986us (1850us total) trans 4294967523 rc 0/0 00000100:00100000:1.0:1782239996.471010:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 67 00000100:00100000:3.0:1782239996.491126:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239996.491246:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738022528 00000100:00100000:0.0:1782239996.491257:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738022528 00000100:00100000:0.0:1782239996.491311:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 68 00000100:00100000:0.0:1782239996.491320:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5c779cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+21:12283:x1868813738022528:12345-192.168.203.32@tcp:35:umount.0 00000100:00100000:0.0:1782239996.491984:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5c779cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+22:12283:x1868813738022528:12345-192.168.203.32@tcp:35:umount.0 Request processed in 663us (865us total) trans 4294967524 rc 0/0 00000100:00100000:0.0:1782239996.491993:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 68 00000100:00100000:1.0:1782239996.499323:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239996.499424:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738022784 00000100:00100000:3.0:1782239996.499434:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738022784 00000100:00100000:3.0:1782239996.499480:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 69 00000100:00100000:3.0:1782239996.499490:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7e63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+22:12283:x1868813738022784:12345-192.168.203.32@tcp:35:umount.0 00000100:00100000:2.0:1782239996.500648:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7e63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+23:12283:x1868813738022784:12345-192.168.203.32@tcp:35:umount.0 Request processed in 1152us (1328us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1782239996.500658:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 69 00000100:00100000:3.0:1782239996.509848:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239996.510805:0:7481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738022912 00000100:00100000:0.0:1782239996.510817:0:7481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738022912 00000100:00100000:0.0:1782239996.510891:0:7481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 17 00000100:00100000:0.0:1782239996.510901:0:7481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d021ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:afaefb1a-536b-42a3-a3ff-47200f8611c3+13:2345:x1868813738022912:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782239996.510917:0:7481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782239996.510936:0:7481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb5c2a45c00/0x8c5345f1c1ec4ce8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e3dc expref: 13 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239996.510952:0:7481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782239996.510999:0:7481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d021ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:afaefb1a-536b-42a3-a3ff-47200f8611c3+12:2345:x1868813738022912:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 99us (1159us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239996.511007:0:7481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 17 00000100:00100000:3.0:1782239996.513800:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239996.513834:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239996.513909:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738023296 00000100:00100000:1.0:1782239996.513918:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738023296 00000100:00100000:1.0:1782239996.513977:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 18 00000100:00100000:1.0:1782239996.513987:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f4896300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:afaefb1a-536b-42a3-a3ff-47200f8611c3+12:2346:x1868813738023296:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782239996.514003:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782239996.514022:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb5c2a45600/0x8c5345f1c1ec4ed2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e4a7 expref: 12 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239996.514039:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782239996.514105:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f4896300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:afaefb1a-536b-42a3-a3ff-47200f8611c3+11:2346:x1868813738023296:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 120us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239996.514113:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 18 00000100:00100000:0.0:1782239996.515056:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738023168 00000100:00100000:0.0:1782239996.515063:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738023168 00000100:00100000:0.0:1782239996.515113:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 72 00000100:00100000:0.0:1782239996.515121:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f4896a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+5:2343:x1868813738023168:12345-192.168.203.32@tcp:9:umount.0 00000020:00000080:0.0:1782239996.515146:0:6589:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8c5345f1c1ec4fc0 00000100:00080000:0.0:1782239996.515154:0:6589:0:(import.c:65:import_set_state_nolock()) ffff9bb5cb15b000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1782239996.515547:0:6589:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:0.0:1782239996.515903:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f4896a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+2:2343:x1868813738023168:12345-192.168.203.32@tcp:9:umount.0 Request processed in 781us (2109us total) trans 0 rc 0/0 00000100:00100000:0.0:1782239996.515911:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 72 00010000:00010000:2.0:1782239996.516014:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1782239996.516453:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782239996.521372:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239996.521505:0:7481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738023040 00000100:00100000:3.0:1782239996.521515:0:7481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738023040 00000100:00100000:3.0:1782239996.521583:0:7481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 19 00000100:00100000:3.0:1782239996.521599:0:7481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5eddf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:afaefb1a-536b-42a3-a3ff-47200f8611c3+11:2344:x1868813738023040:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782239996.521616:0:7481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782239996.521637:0:7481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb602045400/0x8c5345f1c1ec4c4e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e3a4 expref: 11 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239996.521653:0:7481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782239996.521709:0:7481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5eddf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:afaefb1a-536b-42a3-a3ff-47200f8611c3+10:2344:x1868813738023040:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 111us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239996.521716:0:7481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 19 00000100:00100000:0.0:1782239996.530738:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239996.530908:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738023680 00000100:00100000:1.0:1782239996.530918:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738023680 00000100:00100000:1.0:1782239996.530989:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 73 00000100:00100000:1.0:1782239996.530999:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5e8eca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+7:2343:x1868813738023680:12345-192.168.203.32@tcp:9:umount.0 00000020:00000080:1.0:1782239996.531029:0:6588:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8c5345f1c1ec5228 00000020:00010000:1.0:1782239996.531036:0:6588:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9bb5c319a800: total 0 00000100:00080000:1.0:1782239996.531061:0:6588:0:(import.c:65:import_set_state_nolock()) ffff9bb5c319a000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1782239996.531106:0:6588:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00080000:2.0:1782239996.531495:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782239996.531640:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5e8eca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:36dd742b-25b8-431e-bf41-75f2fff47ffb+5:2343:x1868813738023680:12345-192.168.203.32@tcp:9:umount.0 Request processed in 641us (909us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239996.531648:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 73 00000020:00010000:0.0:1782239996.531765:0:5779:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9bb5c319a800: total 0 00010000:00010000:0.0:1782239996.531806:0:5779:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9bb5c319a800, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1782239996.531855:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e90035c2/0x8c5345f1c1ec5c62 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e84a expref: 4 pid: 8312 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239996.531887:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf533121/0x8c5345f1c1ec55c4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e67c expref: 3 pid: 8312 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782239996.531903:0:5779:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9bb5c319a800, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1782239996.531913:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782239996.531915:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782239996.531917:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782239996.549437:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239996.549531:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738024704 00000100:00100000:1.0:1782239996.549553:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738024704 00000100:00100000:1.0:1782239996.549604:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 240 00000100:00100000:1.0:1782239996.549614:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fff01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+23:2343:x1868813738024704:12345-192.168.203.32@tcp:39:umount.0 00000020:00000080:1.0:1782239996.549645:0:5791:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8c5345f1c1ec4c5c 00000020:00010000:1.0:1782239996.549662:0:5791:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9bb5f7af8000: total 0 00000100:00080000:1.0:1782239996.549666:0:5791:0:(import.c:65:import_set_state_nolock()) ffff9bb601370800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1782239996.549739:0:5791:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:1.0:1782239996.550142:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fff01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36dd742b-25b8-431e-bf41-75f2fff47ffb+22:2343:x1868813738024704:12345-192.168.203.32@tcp:39:umount.0 Request processed in 528us (712us total) trans 4294967526 rc 0/0 00000100:00100000:1.0:1782239996.550151:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 240 00000020:00010000:2.0:1782239996.555513:0:5778:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9bb5f7af8000: total 0 00010000:00010000:2.0:1782239996.555524:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782239996.555595:0:5778:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9bb5f7af8000, canceled 0 locks, left on hash table 14. 00010000:00010000:2.0:1782239996.555731:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bb5c30e4000) 00010000:00010000:2.0:1782239996.555735:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1782239996.555923:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26600/0x8c5345f1c1ec5921 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e771 expref: 21 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239996.556263:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bb5c55de700) 00010000:00010000:2.0:1782239996.556265:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1782239996.556272:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38a00/0x8c5345f1c1ec5c4d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e843 expref: 20 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239996.556287:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9bb5c4ed6000) 00010000:00010000:2.0:1782239996.556289:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782239996.556293:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29f400/0x8c5345f1c1ec4f26 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e4b5 expref: 19 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239996.556310:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bb5d0df4300) 00010000:00010000:2.0:1782239996.556312:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1782239996.556316:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27800/0x8c5345f1c1ec55af lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e675 expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239996.556326:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bb5d0df4300) 00010000:00010000:2.0:1782239996.556328:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782239996.556331:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602173800/0x8c5345f1c1ec54a5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e62f expref: 17 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239996.556343:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bb5c4ed6b00) 00010000:00010000:2.0:1782239996.556345:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1782239996.556358:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29f600/0x8c5345f1c1ec4f96 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e4d1 expref: 16 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239996.556373:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bb5c55de700) 00010000:00010000:2.0:1782239996.556375:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782239996.556378:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29e600/0x8c5345f1c1ec5b43 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e7fd expref: 15 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239996.556471:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bb5c4ed6b00) 00010000:00010000:2.0:1782239996.556473:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1782239996.556483:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5ee29ec00/0x8c5345f1c1ec5283 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e5a3 expref: 14 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239996.556497:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bb5c30e4000) 00010000:00010000:2.0:1782239996.556499:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1782239996.556509:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030800/0x8c5345f1c1ec5642 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e69f expref: 13 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239996.556522:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bb5d0df4300) 00010000:00010000:2.0:1782239996.556524:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782239996.556535:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb602172a00/0x8c5345f1c1ec559a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e66e expref: 12 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239996.556547:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bb5c55de700) 00010000:00010000:2.0:1782239996.556549:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782239996.556553:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38e00/0x8c5345f1c1ec5c23 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e835 expref: 11 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239996.556567:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bb5c55de500) 00010000:00010000:2.0:1782239996.556576:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782239996.556581:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030a00/0x8c5345f1c1ec5626 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e698 expref: 10 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239996.556595:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bb5d0df4b00) 00010000:00010000:2.0:1782239996.556598:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782239996.556601:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c2a44e00/0x8c5345f1c1ec4f42 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e4bc expref: 9 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239996.556616:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bb5d0df4300) 00010000:00010000:2.0:1782239996.556618:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1782239996.556622:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26200/0x8c5345f1c1ec557e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e667 expref: 8 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239996.556633:0:5778:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9bb5f7af8000, canceled 14 locks, left on hash table 0. 00010000:00010000:2.0:1782239996.556652:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782239996.556654:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782239996.556656:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1782239996.756260:0:7493:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 36dd742b-25b8-431e-bf41-75f2fff47ffb 00000020:00000080:2.0:1782239996.756270:0:7493:0:(genops.c:906:class_export_put()) final put ffff9bb5f7cda800/36dd742b-25b8-431e-bf41-75f2fff47ffb 00000020:00000080:1.0:1782239996.756350:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9bb5f7cda800/36dd742b-25b8-431e-bf41-75f2fff47ffb for lustre-OST0001 00000020:00000080:1.0:1782239996.756408:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9bb5cb15b000 for lustre-OST0001 00010000:00010000:0.0:1782239997.150957:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782239998.175994:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782239998.654257:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239998.654371:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782239998.670685:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738024832 00000100:00100000:3.0:1782239998.670698:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738024832 00000100:00100000:3.0:1782239998.670795:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738024960 00000100:00100000:3.0:1782239998.670798:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738024960 00000100:00100000:3.0:1782239998.670833:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 20 00000100:00100000:3.0:1782239998.670843:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fbe08380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:afaefb1a-536b-42a3-a3ff-47200f8611c3+11:2347:x1868813738024832:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782239998.670859:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782239998.670878:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb5c1677e00/0x8c5345f1c1ec4d2e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e3f1 expref: 11 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239998.670896:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782239998.670951:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fbe08380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:afaefb1a-536b-42a3-a3ff-47200f8611c3+10:2347:x1868813738024832:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 109us (16702us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239998.670958:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 20 00000100:00100000:3.0:1782239998.670974:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 21 00000100:00100000:3.0:1782239998.670979:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fbe08a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:afaefb1a-536b-42a3-a3ff-47200f8611c3+9:2347:x1868813738024960:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782239998.670987:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782239998.670995:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb5c2a45800/0x8c5345f1c1ec4d35 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e41b expref: 9 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782239998.671017:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782239998.671033:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fbe08a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:afaefb1a-536b-42a3-a3ff-47200f8611c3+8:2347:x1868813738024960:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 54us (16663us total) trans 0 rc 0/0 00000100:00100000:3.0:1782239998.671039:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 21 00000100:00100000:0.0:1782239998.671341:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782239998.671466:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782239998.671561:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738025344 00000100:00100000:2.0:1782239998.671566:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738025344 00000100:00100000:2.0:1782239998.671617:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 241 00000100:00100000:2.0:1782239998.671625:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7810000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f135cc01-3d42-4f2a-80ff-79724f1d3285+6:2343:x1868813738025344:12345-192.168.203.32@tcp:39:umount.0 00000020:00000080:2.0:1782239998.671657:0:5790:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8c5345f1c1ec4d43 00000020:00010000:2.0:1782239998.671673:0:5790:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9bb5f7cdd800: total 0 00000100:00080000:2.0:1782239998.671677:0:5790:0:(import.c:65:import_set_state_nolock()) ffff9bb5f7cdd000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1782239998.671699:0:5790:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00100000:2.0:1782239998.671929:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7810000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f135cc01-3d42-4f2a-80ff-79724f1d3285+5:2343:x1868813738025344:12345-192.168.203.32@tcp:39:umount.0 Request processed in 304us (461us total) trans 4294967527 rc 0/0 00000100:00100000:2.0:1782239998.671936:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 241 00000020:00010000:2.0:1782239998.671958:0:5779:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9bb5f7cdd800: total 0 00010000:00010000:2.0:1782239998.671992:0:5779:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9bb5f7cdd800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1782239998.672018:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bb5c55de500) 00010000:00010000:2.0:1782239998.672021:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782239998.672027:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f4436000/0x8c5345f1c1ec5c70 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e851 expref: 4 pid: 6611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239998.672045:0:5779:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9bb5f7cdd800, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1782239998.672054:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782239998.672056:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782239998.672058:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1782239998.672456:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782239998.673269:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738025088 00000100:00100000:1.0:1782239998.673277:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738025088 00000100:00100000:1.0:1782239998.673329:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 22 00000100:00100000:1.0:1782239998.673337:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7811c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:afaefb1a-536b-42a3-a3ff-47200f8611c3+8:2346:x1868813738025088:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782239998.673348:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782239998.673363:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb5c2a44600/0x8c5345f1c1ec4ecb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e4a0 expref: 8 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782239998.673387:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782239998.673456:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7811c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:afaefb1a-536b-42a3-a3ff-47200f8611c3+7:2346:x1868813738025088:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 119us (2117us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239998.673464:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 22 00000100:00100000:0.0:1782239998.701118:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782239998.701216:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738025600 00000100:00100000:1.0:1782239998.701226:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738025600 00000100:00100000:1.0:1782239998.701285:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 306 00000100:00100000:1.0:1782239998.701297:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5decbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afaefb1a-536b-42a3-a3ff-47200f8611c3+7:2343:x1868813738025600:12345-192.168.203.32@tcp:251:umount.0 00000020:00000080:1.0:1782239998.701355:0:5784:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8c5345f1c1ec4c39 00000020:00010000:1.0:1782239998.701371:0:5784:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9bb601371000: total 0 00000100:00080000:1.0:1782239998.701376:0:5784:0:(import.c:65:import_set_state_nolock()) ffff9bb601372000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1782239998.701470:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5decbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afaefb1a-536b-42a3-a3ff-47200f8611c3+3:2343:x1868813738025600:12345-192.168.203.32@tcp:251:umount.0 Request processed in 175us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239998.701477:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 306 00000020:00010000:2.0:1782239998.701599:0:5778:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9bb601371000: total 0 00010000:00010000:2.0:1782239998.701603:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782239998.701655:0:5778:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9bb601371000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1782239998.701687:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb5c2a45a00/0x8c5345f1c1ec4cef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e3e3 expref: 2 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782239998.701700:0:5778:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9bb601371000, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1782239998.701708:0:5778:0:(genops.c:906:class_export_put()) final put ffff9bb601371000/afaefb1a-536b-42a3-a3ff-47200f8611c3 00010000:00010000:2.0:1782239998.701727:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782239998.701729:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782239998.701730:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782239998.702251:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9bb601371000/afaefb1a-536b-42a3-a3ff-47200f8611c3 for MGS 00000020:00000080:1.0:1782239998.702284:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9bb601372000 for MGS 00010000:00010000:2.0:1782239999.198964:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782239999.265245:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fc2a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813758976640:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782239999.265319:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782239999.265415:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758976640 00000100:00100000:1.0:1782239999.265424:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758976640 00000100:00100000:1.0:1782239999.265479:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1782239999.265488:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc2abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1868813758976640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782239999.265525:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782239999.265568:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc2abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1868813758976640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1782239999.265575:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1782239999.265620:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fc2a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813758976640:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1782239999.265864:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1782240000.228167:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782240000.287116:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fbe09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1868813758977024:0@lo:400:kworker.0 00000100:00100000:2.0:1782240000.287187:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782240000.287250:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782240000.287332:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fbe08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1868813758977152:0@lo:400:kworker.0 00000100:00100000:2.0:1782240000.287361:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782240000.287399:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758977024 00000100:00100000:2.0:1782240000.287407:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758977024 00000100:00100000:2.0:1782240000.287461:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1782240000.287470:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fbe0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1868813758977024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782240000.287519:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fbe0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1868813758977024:12345-0@lo:400:kworker.0 Request processed in 51us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1782240000.287527:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1782240000.287550:0:8312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758977152 00000100:00100000:2.0:1782240000.287553:0:8312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758977152 00000100:00100000:2.0:1782240000.287575:0:8312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1782240000.287581:0:8312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fbe09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1868813758977152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782240000.287612:0:8312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fbe09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1868813758977152:12345-0@lo:400:kworker.0 Request processed in 30us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1782240000.287618:0:8312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:2.0:1782240000.287633:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782240000.287665:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fbe08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1868813758977152:0@lo:400:kworker.0 00000100:00100000:2.0:1782240000.287675:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fbe09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1868813758977024:0@lo:400:kworker.0 00000100:00100000:3.0:1782240000.287872:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fbe08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3306:1868813758976768:0@lo:400:kworker.0 00000100:00100000:0.0:1782240000.287887:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fbe0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1868813758976896:0@lo:400:kworker.0 00000100:00100000:3.0:1782240000.287913:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782240000.287928:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782240000.287962:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fbe0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1868813758977280:0@lo:400:kworker.0 00000100:00100000:0.0:1782240000.287964:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fbe0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1868813758977408:0@lo:400:kworker.0 00000100:00100000:3.0:1782240000.288000:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782240000.288009:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782240000.288052:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758977408 00000100:00100000:3.0:1782240000.288056:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758977408 00000100:00100000:3.0:1782240000.288108:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1782240000.288127:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7d0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1868813758977408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782240000.288171:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7d0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1868813758977408:12345-0@lo:400:kworker.0 Request processed in 55us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1782240000.288179:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1782240000.288369:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758976896 00000100:00100000:2.0:1782240000.288374:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758976896 00000100:00100000:2.0:1782240000.288394:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758977280 00000100:00100000:2.0:1782240000.288397:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758977280 00000100:00100000:2.0:1782240000.288413:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1782240000.288428:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7d0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1868813758976896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782240000.288463:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7d0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1868813758976896:12345-0@lo:400:kworker.0 Request processed in 35us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1782240000.288471:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1782240000.288502:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1782240000.288513:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f4894380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1868813758977280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782240000.288557:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f4894380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1868813758977280:12345-0@lo:400:kworker.0 Request processed in 46us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1782240000.288621:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758976768 00000100:00100000:1.0:1782240000.288631:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758976768 00000100:00100000:0.0:1782240000.288664:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fbe0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1868813758976896:0@lo:400:kworker.0 00000100:00100000:1.0:1782240000.288666:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:1.0:1782240000.288677:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5decbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:3306:x1868813758976768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782240000.288683:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fbe0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1868813758977408:0@lo:400:kworker.0 00000100:00100000:1.0:1782240000.288730:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5decbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:3306:x1868813758976768:12345-0@lo:400:kworker.0 Request processed in 55us (817us total) trans 0 rc 0/0 00000100:00100000:1.0:1782240000.288778:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00080000:1.0:1782240000.288943:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782240000.288947:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782240000.289377:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fbe08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3306:1868813758976768:0@lo:400:kworker.0 00000100:00100000:2.0:1782240000.289389:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fbe0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1868813758977280:0@lo:400:kworker.0 00000100:00100000:3.0:1782240000.305179:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000001:00080000:1.0:1782240000.342891:0:5812:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967524 is committed 00000001:00100000:1.0:1782240000.342917:0:5812:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 36dd742b-25b8-431e-bf41-75f2fff47ffb 00000001:00080000:1.0:1782240000.342924:0:5812:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000001:00100000:1.0:1782240000.342946:0:5812:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f135cc01-3d42-4f2a-80ff-79724f1d3285 00000001:00080000:1.0:1782240000.342954:0:5812:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:1.0:1782240000.342957:0:5812:0:(genops.c:906:class_export_put()) final put ffff9bb5f7cdd800/f135cc01-3d42-4f2a-80ff-79724f1d3285 00000020:00000080:1.0:1782240000.342976:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9bb5f7cdd800/f135cc01-3d42-4f2a-80ff-79724f1d3285 for lustre-MDT0000 00000020:00000080:1.0:1782240000.343028:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9bb5f7cdd000 for lustre-MDT0000 00000020:00000080:2.0:1782240000.343566:0:5812:0:(genops.c:906:class_export_put()) final put ffff9bb5f7af8000/36dd742b-25b8-431e-bf41-75f2fff47ffb 00000020:00000080:1.0:1782240000.345028:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9bb5f7af8000/36dd742b-25b8-431e-bf41-75f2fff47ffb for lustre-MDT0000 00000020:00000080:1.0:1782240000.345098:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9bb601370800 for lustre-MDT0000 00000001:00100000:3.0:1782240000.374124:0:6614:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 36dd742b-25b8-431e-bf41-75f2fff47ffb 00000020:00000080:3.0:1782240000.374133:0:6614:0:(genops.c:906:class_export_put()) final put ffff9bb5c319a800/36dd742b-25b8-431e-bf41-75f2fff47ffb 00000020:00000080:3.0:1782240000.374165:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9bb5c319a800/36dd742b-25b8-431e-bf41-75f2fff47ffb for lustre-OST0000 00000020:00000080:3.0:1782240000.374220:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9bb5c319a000 for lustre-OST0000 00000100:00100000:3.0:1782240000.801498:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782240000.801521:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f4894a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813758977536:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782240000.801596:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782240000.801667:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758977536 00000100:00100000:3.0:1782240000.801675:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758977536 00000100:00100000:3.0:1782240000.801724:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1782240000.801734:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f4895880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1868813758977536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782240000.801810:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782240000.801853:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f4895880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1868813758977536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1782240000.801872:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1782240000.801924:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f4894a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813758977536:0@lo:13:osp-pre-1-0.0 00000020:01000004:3.0:1782240001.021034:0:12720:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1782240001.041266:0:12720:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1782240001.041314:0:12720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5c1677200/0x8c5345f1c1ec4cbe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4cc5 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240001.041327:0:12720:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5c1677200/0x8c5345f1c1ec4cbe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c5345f1c1ec4cc5 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240001.041335:0:12720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5c1677200/0x8c5345f1c1ec4cbe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x8c5345f1c1ec4cc5 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240001.041342:0:12720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.132@tcp lock: ffff9bb5c1677200/0x8c5345f1c1ec4cbe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x8c5345f1c1ec4cc5 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240001.041412:0:12720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1782240001.041418:0:12720:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1782240001.041445:0:12720:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1782240001.041455:0:12720:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1782240001.041460:0:12720:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1782240001.041484:0:12720:0:(import.c:65:import_set_state_nolock()) ffff9bb6013aa000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1782240001.041567:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f4894a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1868813758977664:0@lo:39:umount.0 00000100:00100000:0.0:1782240001.041642:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782240001.041788:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758977664 00000100:00100000:3.0:1782240001.041796:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758977664 00000100:00100000:3.0:1782240001.041841:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1782240001.041849:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f77a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1868813758977664:12345-0@lo:39:umount.0 00000020:00000080:3.0:1782240001.041874:0:5791:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8c5345f1c1ec4a48 00000100:00080000:3.0:1782240001.041883:0:5791:0:(import.c:65:import_set_state_nolock()) ffff9bb5edceb800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1782240001.042198:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782240001.042206:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.132@tcp lock: ffff9bb5c1677200/0x8c5345f1c1ec4cbe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x8c5345f1c1ec4cc5 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240001.042215:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5c1677200 already unused, calling callback (ffffffffc1d0cc20) 10000000:00010000:2.0:1782240001.042219:0:5779:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.132@tcp lock: ffff9bb5c1677200/0x8c5345f1c1ec4cbe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x8c5345f1c1ec4cc5 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240001.042228:0:5779:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.132@tcp lock: ffff9bb5c1677200/0x8c5345f1c1ec4cbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x8c5345f1c1ec4cc5 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782240001.042236:0:5779:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.132@tcp lock: ffff9bb5c1677200/0x8c5345f1c1ec4cbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x8c5345f1c1ec4cc5 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782240001.042243:0:5779:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1782240001.042245:0:5779:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1782240001.042247:0:5779:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00100000:3.0:1782240001.042522:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f77a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3303:x1868813758977664:12345-0@lo:39:umount.0 Request processed in 671us (877us total) trans 0 rc 0/0 00000100:00100000:3.0:1782240001.042531:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:3.0:1782240001.042540:0:5791:0:(genops.c:906:class_export_put()) final put ffff9bb5edcef000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:3.0:1782240001.042575:0:5779:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.132@tcp lock: ffff9bb5c1677200/0x8c5345f1c1ec4cbe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x8c5345f1c1ec4cc5 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240001.042582:0:5779:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782240001.042599:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.132@tcp lock: ffff9bb5c1677200/0x8c5345f1c1ec4cbe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x8c5345f1c1ec4cc5 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240001.042617:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.132@tcp lock: ffff9bb5c1677200/0x8c5345f1c1ec4cbe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x8c5345f1c1ec4cc5 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240001.042630:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782240001.042632:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782240001.042664:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782240001.042675:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f4894700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3304:1868813758977792:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782240001.042723:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782240001.042785:0:7481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758977792 00000100:00100000:0.0:1782240001.042789:0:7481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758977792 00000100:00100000:0.0:1782240001.042826:0:7481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1782240001.042833:0:7481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f77a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:3304:x1868813758977792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782240001.042843:0:7481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782240001.042855:0:7481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb5c1676a00/0x8c5345f1c1ec4cc5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8c5345f1c1ec4cbe expref: 19 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240001.042869:0:7481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782240001.042897:0:7481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f77a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+18:3304:x1868813758977792:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1782240001.042904:0:7481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1782240001.042939:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f4894700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3304:1868813758977792:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1782240001.042968:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9bb6013aa000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1782240001.042979:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f4894a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1868813758977664:0@lo:39:umount.0 00010000:00010000:2.0:1782240001.044201:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782240001.044259:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1782240001.044282:0:12720:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1782240001.044286:0:12720:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1782240001.044293:0:12720:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1782240001.045478:0:12720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb602044600/0x8c5345f1c1ec4ccc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4cd3 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240001.045508:0:12720:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb602044600/0x8c5345f1c1ec4ccc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c5345f1c1ec4cd3 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240001.045516:0:12720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb602044600/0x8c5345f1c1ec4ccc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x8c5345f1c1ec4cd3 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240001.045522:0:12720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.132@tcp lock: ffff9bb602044600/0x8c5345f1c1ec4ccc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x8c5345f1c1ec4cd3 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240001.045590:0:12720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782240001.045597:0:12720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5c1676e00/0x8c5345f1c1ec4bf3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4bfa expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240001.045611:0:12720:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5c1676e00/0x8c5345f1c1ec4bf3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c5345f1c1ec4bfa expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240001.045617:0:12720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5c1676e00/0x8c5345f1c1ec4bf3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x8c5345f1c1ec4bfa expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240001.045624:0:12720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.132@tcp lock: ffff9bb5c1676e00/0x8c5345f1c1ec4bf3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x8c5345f1c1ec4bfa expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240001.045897:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782240001.045904:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.132@tcp lock: ffff9bb602044600/0x8c5345f1c1ec4ccc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x8c5345f1c1ec4cd3 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240001.045924:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb602044600 already unused, calling callback (ffffffffc1d0cc20) 10000000:00010000:2.0:1782240001.045928:0:5778:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.132@tcp lock: ffff9bb602044600/0x8c5345f1c1ec4ccc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x8c5345f1c1ec4cd3 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240001.045937:0:5778:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.132@tcp lock: ffff9bb602044600/0x8c5345f1c1ec4ccc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x8c5345f1c1ec4cd3 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782240001.045944:0:5778:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.132@tcp lock: ffff9bb602044600/0x8c5345f1c1ec4ccc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x8c5345f1c1ec4cd3 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782240001.045951:0:5778:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1782240001.045953:0:5778:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1782240001.045986:0:5778:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.132@tcp lock: ffff9bb602044600/0x8c5345f1c1ec4ccc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x8c5345f1c1ec4cd3 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240001.045991:0:5778:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1782240001.046051:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fbe0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3306:1868813758977920:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782240001.046138:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782240001.046315:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.132@tcp lock: ffff9bb602044600/0x8c5345f1c1ec4ccc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x8c5345f1c1ec4cd3 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240001.046323:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.132@tcp lock: ffff9bb602044600/0x8c5345f1c1ec4ccc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x8c5345f1c1ec4cd3 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240001.046336:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782240001.046338:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.132@tcp lock: ffff9bb5c1676e00/0x8c5345f1c1ec4bf3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x8c5345f1c1ec4bfa expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240001.046343:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5c1676e00 already unused, calling callback (ffffffffc1d0cc20) 10000000:00010000:2.0:1782240001.046346:0:5778:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.132@tcp lock: ffff9bb5c1676e00/0x8c5345f1c1ec4bf3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x8c5345f1c1ec4bfa expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240001.046363:0:5778:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.132@tcp lock: ffff9bb5c1676e00/0x8c5345f1c1ec4bf3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x8c5345f1c1ec4bfa expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782240001.046370:0:5778:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.132@tcp lock: ffff9bb5c1676e00/0x8c5345f1c1ec4bf3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x8c5345f1c1ec4bfa expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782240001.046374:0:5778:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1782240001.046377:0:5778:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:2.0:1782240001.046390:0:5778:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.132@tcp lock: ffff9bb5c1676e00/0x8c5345f1c1ec4bf3 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x8c5345f1c1ec4bfa expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240001.046395:0:5778:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1782240001.046427:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782240001.046434:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fbe08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3306:1868813758978048:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782240001.046459:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782240001.046496:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758977920 00000100:00100000:0.0:1782240001.046502:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758977920 00000100:00100000:0.0:1782240001.046539:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758978048 00000100:00100000:0.0:1782240001.046542:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758978048 00000100:00100000:0.0:1782240001.046562:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1782240001.046571:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d0219050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+19:3306:x1868813758977920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782240001.046584:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782240001.046598:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb5c1676000/0x8c5345f1c1ec4cd3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8c5345f1c1ec4ccc expref: 19 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240001.046621:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782240001.046656:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d0219050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+18:3306:x1868813758977920:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1782240001.046663:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1782240001.046702:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1782240001.046720:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f77a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+17:3306:x1868813758978048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782240001.046727:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782240001.046735:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb5c0030000/0x8c5345f1c1ec4bfa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8c5345f1c1ec4bf3 expref: 17 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240001.046776:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782240001.046800:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f77a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+16:3306:x1868813758978048:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1782240001.046805:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1782240001.046849:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fbe08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3306:1868813758978048:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782240001.046859:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fbe0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3306:1868813758977920:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782240001.046948:0:12720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 10000000:01000000:3.0:1782240001.046955:0:12720:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1782240001.046963:0:12720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5ee29f800/0x8c5345f1c1ec4ef5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4efc expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240001.046971:0:12720:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5ee29f800/0x8c5345f1c1ec4ef5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c5345f1c1ec4efc expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240001.046990:0:12720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5ee29f800/0x8c5345f1c1ec4ef5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x8c5345f1c1ec4efc expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240001.046997:0:12720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.132@tcp lock: ffff9bb5ee29f800/0x8c5345f1c1ec4ef5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x8c5345f1c1ec4efc expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240001.047006:0:12720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782240001.047012:0:12720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a44800/0x8c5345f1c1ec49a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec49ae expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240001.047030:0:12720:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a44800/0x8c5345f1c1ec49a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c5345f1c1ec49ae expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240001.047036:0:12720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a44800/0x8c5345f1c1ec49a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x8c5345f1c1ec49ae expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240001.047042:0:12720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a44800/0x8c5345f1c1ec49a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x8c5345f1c1ec49ae expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240001.047049:0:12720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1782240001.047052:0:12720:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:3.0:1782240001.047055:0:12720:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:3.0:1782240001.047094:0:12720:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1782240001.047099:0:12720:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:3.0:1782240001.047104:0:12720:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1782240001.047109:0:12720:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/7 00000020:00080000:3.0:1782240001.047115:0:12720:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9bb5f390c000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1782240001.047120:0:12720:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9bb5f7afd800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1782240001.047134:0:12720:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff9bb5c6bf19c0) has exports, disconnecting them 00000020:00080000:3.0:1782240001.047138:0:12720:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9bb5f390c000), last request at 1782240000 00000020:00000080:3.0:1782240001.047144:0:12720:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8c5345f1c1ec4bbb 00000100:00080000:3.0:1782240001.047160:0:12720:0:(import.c:65:import_set_state_nolock()) ffff9bb5f7cd9800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1782240001.047198:0:12720:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9bb5f390c000): rc 0 00000020:00000080:3.0:1782240001.047201:0:12720:0:(genops.c:906:class_export_put()) final put ffff9bb5f390c000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1782240001.047206:0:12720:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9bb5f7afd800), last request at 1782240000 00000020:00000080:3.0:1782240001.047209:0:12720:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8c5345f1c1ec4af0 00000100:00080000:3.0:1782240001.047214:0:12720:0:(import.c:65:import_set_state_nolock()) ffff9bb5f7afb000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1782240001.047220:0:12720:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9bb5f7afd800): rc 0 00000020:00000080:3.0:1782240001.047222:0:12720:0:(genops.c:906:class_export_put()) final put ffff9bb5f7afd800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:3.0:1782240001.047229:0:12720:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffc134c15efae0 00000100:00080000:3.0:1782240001.047246:0:12720:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1782240001.047249:0:12720:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:3.0:1782240001.047261:0:12720:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1782240001.047319:0:12720:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1782240001.047332:0:12720:0:(import.c:65:import_set_state_nolock()) ffff9bb5fbba5000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1782240001.047343:0:12720:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1782240001.047345:0:12720:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:3.0:1782240001.047354:0:12720:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1782240001.047419:0:12720:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1782240001.047427:0:12720:0:(import.c:65:import_set_state_nolock()) ffff9bb5fbba7800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1782240001.047457:0:12720:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9bb5c6bf19c0) has no exports 00000020:00000080:3.0:1782240001.047843:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9bb5edcef000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1782240001.047899:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9bb5f390c000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1782240001.047929:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9bb5f7afd800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1782240001.047960:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9bb5edceb800 for lustre-MDT0000 00000020:00000080:3.0:1782240001.047966:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9bb5f7cd9800 for lustre-MDT0000 00000020:00000080:3.0:1782240001.047983:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9bb5f7afb000 for lustre-MDT0000 00010000:00010000:0.0:1782240001.048459:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:0.0:1782240001.048503:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f4895500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1868813758978176:0@lo:9:umount.0 00000100:00100000:0.0:1782240001.048560:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782240001.048590:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f4896300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1868813758978304:0@lo:9:umount.0 00010000:00010000:2.0:1782240001.048774:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.132@tcp lock: ffff9bb5c1676e00/0x8c5345f1c1ec4bf3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x8c5345f1c1ec4bfa expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240001.048785:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.132@tcp lock: ffff9bb5c1676e00/0x8c5345f1c1ec4bf3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x8c5345f1c1ec4bfa expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240001.048805:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782240001.048809:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a44800/0x8c5345f1c1ec49a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x8c5345f1c1ec49ae expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240001.048817:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5c2a44800 already unused, calling callback (ffffffffc1d0cc20) 10000000:00010000:2.0:1782240001.048821:0:5778:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a44800/0x8c5345f1c1ec49a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x8c5345f1c1ec49ae expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240001.048831:0:5778:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a44800/0x8c5345f1c1ec49a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x8c5345f1c1ec49ae expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782240001.048838:0:5778:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a44800/0x8c5345f1c1ec49a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x8c5345f1c1ec49ae expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782240001.048846:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:2.0:1782240001.048855:0:5778:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1782240001.048859:0:5778:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1782240001.048862:0:5778:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000100:00100000:0.0:1782240001.048889:0:8312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758978176 00010000:00010000:2.0:1782240001.048892:0:5778:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a44800/0x8c5345f1c1ec49a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x8c5345f1c1ec49ae expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782240001.048896:0:8312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758978176 00010000:00010000:2.0:1782240001.048903:0:5778:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782240001.048925:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a44800/0x8c5345f1c1ec49a7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x8c5345f1c1ec49ae expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240001.048933:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a44800/0x8c5345f1c1ec49a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x8c5345f1c1ec49ae expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240001.048947:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782240001.048950:0:8312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758978304 00010000:00010000:2.0:1782240001.048951:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782240001.048955:0:8312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758978304 00010000:00010000:2.0:1782240001.048956:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782240001.048966:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782240001.048978:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fbe09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3305:1868813758978432:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782240001.048985:0:8312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1782240001.048994:0:8312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f77a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1868813758978176:12345-0@lo:9:umount.0 00000100:00100000:2.0:1782240001.049015:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:0.0:1782240001.049221:0:8312:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8c5345f1c1ec4b4b 00000100:00080000:0.0:1782240001.049230:0:8312:0:(import.c:65:import_set_state_nolock()) ffff9bb5f460e800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1782240001.049270:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1782240001.049271:0:8312:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:0.0:1782240001.050304:0:8312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f77a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3303:x1868813758978176:12345-0@lo:9:umount.0 Request processed in 1307us (1740us total) trans 0 rc 0/0 00000100:00100000:0.0:1782240001.050313:0:8312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1782240001.050333:0:8312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1782240001.050341:0:8312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f77a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1868813758978304:12345-0@lo:9:umount.0 00000020:00000080:0.0:1782240001.050361:0:8312:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8c5345f1c1ec4c24 00000100:00080000:0.0:1782240001.050368:0:8312:0:(import.c:65:import_set_state_nolock()) ffff9bb601377000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1782240001.050406:0:8312:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00010000:00010000:3.0:1782240001.051337:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1782240001.051841:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782240001.051887:0:8312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f77a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3303:x1868813758978304:12345-0@lo:9:umount.0 Request processed in 1543us (3038us total) trans 0 rc 0/0 00000100:00100000:0.0:1782240001.051897:0:8312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:2.0:1782240001.051900:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9bb5fbba5000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1782240001.051922:0:3303:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1782240001.051925:0:3303:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1782240001.051931:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f4895500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1868813758978176:0@lo:9:umount.0 00000100:00080000:2.0:1782240001.051952:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9bb5fbba7800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1782240001.051952:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758978432 00000100:00100000:0.0:1782240001.051961:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758978432 00000004:00080000:2.0:1782240001.051964:0:3303:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1782240001.051966:0:3303:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1782240001.051969:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f4896300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1868813758978304:0@lo:9:umount.0 00000100:00100000:0.0:1782240001.052007:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1782240001.052017:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fbe08e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+16:3305:x1868813758978432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782240001.052045:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782240001.052063:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb5c0031600/0x8c5345f1c1ec49ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8c5345f1c1ec49a7 expref: 16 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240001.052080:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782240001.052091:0:12721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782240001.052101:0:12721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782240001.052103:0:12721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782240001.052127:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fbe08e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+15:3305:x1868813758978432:12345-0@lo:103:ldlm_bl.0 Request processed in 111us (3110us total) trans 0 rc 0/0 00000100:00100000:0.0:1782240001.052134:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1782240001.052145:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fbe09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3305:1868813758978432:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782240001.052160:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.132@tcp lock: ffff9bb5ee29f800/0x8c5345f1c1ec4ef5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x8c5345f1c1ec4efc expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240001.052170:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5ee29f800 already unused, calling callback (ffffffffc1d0cc20) 10000000:00010000:0.0:1782240001.052175:0:5779:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.132@tcp lock: ffff9bb5ee29f800/0x8c5345f1c1ec4ef5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x8c5345f1c1ec4efc expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240001.052184:0:5779:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.132@tcp lock: ffff9bb5ee29f800/0x8c5345f1c1ec4ef5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x8c5345f1c1ec4efc expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782240001.052191:0:5779:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.132@tcp lock: ffff9bb5ee29f800/0x8c5345f1c1ec4ef5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x8c5345f1c1ec4efc expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782240001.052197:0:5779:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1782240001.052200:0:5779:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1782240001.052203:0:5779:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1782240001.052228:0:5779:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.132@tcp lock: ffff9bb5ee29f800/0x8c5345f1c1ec4ef5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x8c5345f1c1ec4efc expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240001.052234:0:5779:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782240001.052263:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.132@tcp lock: ffff9bb5ee29f800/0x8c5345f1c1ec4ef5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x8c5345f1c1ec4efc expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240001.052281:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.132@tcp lock: ffff9bb5ee29f800/0x8c5345f1c1ec4ef5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x8c5345f1c1ec4efc expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240001.052294:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782240001.052297:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782240001.052299:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782240001.052347:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782240001.052361:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f77a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3304:1868813758978560:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782240001.052412:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782240001.052487:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758978560 00000100:00100000:0.0:1782240001.052490:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758978560 00000100:00100000:0.0:1782240001.052518:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1782240001.052525:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f4894a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+15:3304:x1868813758978560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782240001.052533:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782240001.052543:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb5f7e39a00/0x8c5345f1c1ec4efc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8c5345f1c1ec4ef5 expref: 15 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240001.052553:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782240001.052735:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f4894a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7+14:3304:x1868813758978560:12345-0@lo:103:ldlm_bl.0 Request processed in 209us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1782240001.052819:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1782240001.053014:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f77a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3304:1868813758978560:0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1782240001.084949:0:12720:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9bb5c6bf19c0) has no exports 00000020:00000080:2.0:1782240001.155630:0:12720:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8c5345f1c1ec4a02 00000020:00000080:2.0:1782240001.155645:0:12720:0:(genops.c:906:class_export_put()) final put ffff9bb5edced000/lustre-QMT0000_UUID 00000020:01000000:2.0:1782240001.155723:0:12720:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1782240001.155888:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9bb5edced000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1782240001.155912:0:12720:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1782240001.155921:0:12720:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1782240001.155925:0:12720:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff9bb5d1bdcd40) has no exports 00000020:00000080:3.0:1782240001.156605:0:12720:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8c5345f1c1ec49fb 00000020:00000080:3.0:1782240001.156612:0:12720:0:(genops.c:906:class_export_put()) final put ffff9bb601340800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1782240001.156683:0:12720:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1782240001.156690:0:12720:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1782240001.156693:0:12720:0:(genops.c:906:class_export_put()) final put ffff9bb6013a9000/lustre-QMT0000_UUID 00000020:00000080:3.0:1782240001.156696:0:12720:0:(genops.c:865:class_export_destroy()) destroying export ffff9bb6013a9000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1782240001.156712:0:12720:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:0.0:1782240001.156969:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9bb601340800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1782240001.157028:0:12720:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9bb5f788ff60 - data ffff9bb4c14f05e8/ffff9bb5f7b53c00 00000020:01000000:3.0:1782240001.157185:0:12720:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9bb5c8493f60 - data ffff9bb5e9249510/ffff9bb5fc191c00 00000001:00000004:3.0:1782240001.169975:0:12720:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00010000:00010000:3.0:1782240001.246953:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1782240001.282667:0:12720:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1782240001.282675:0:12720:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:3.0:1782240001.282864:0:12720:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1782240001.282868:0:12720:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1782240001.283338:0:7048:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1782240001.283343:0:7048:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:1.0:1782240001.283354:0:7048:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1782240001.284486:0:12720:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1782240001.284502:0:12720:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:3.0:1782240001.285210:0:12720:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1782240001.285224:0:12720:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1782240001.295659:0:7868:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1782240001.295668:0:7868:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:1.0:1782240001.295686:0:7868:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1782240001.388370:0:12720:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8c5345f1c1ec49ca 00000020:00000080:3.0:1782240001.388383:0:12720:0:(genops.c:906:class_export_put()) final put ffff9bb601370000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1782240001.388586:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9bb601370000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1782240001.390333:0:12720:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8c5345f1c1ec49df 00000020:00000080:3.0:1782240001.390342:0:12720:0:(genops.c:906:class_export_put()) final put ffff9bb5f4998800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1782240001.390363:0:12720:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1782240001.390370:0:12720:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1782240001.390379:0:12720:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1782240001.390383:0:12720:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff9bb5c6bf0000) has no exports 00000004:01000000:3.0:1782240001.390544:0:12720:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1782240001.390553:0:12720:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8c5345f1c1ec4c1d 00000020:00000080:3.0:1782240001.390557:0:12720:0:(genops.c:906:class_export_put()) final put ffff9bb5f7cd8800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1782240001.390561:0:12720:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1782240001.390564:0:12720:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1782240001.390570:0:12720:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1782240001.390573:0:12720:0:(genops.c:1579:class_disconnect_exports()) OBD device 17 (ffff9bb5ef7a8000) has no exports 00000020:00000080:3.0:1782240001.390578:0:12720:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8c5345f1c1ec4c16 00000020:00000080:3.0:1782240001.390581:0:12720:0:(genops.c:906:class_export_put()) final put ffff9bb5cf67f000/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1782240001.391130:0:12720:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1782240001.391135:0:12720:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1782240001.391139:0:12720:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:3.0:1782240001.391145:0:12720:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1782240001.391147:0:12720:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1782240001.391176:0:12720:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1782240001.391184:0:12720:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1782240001.391189:0:12720:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8c5345f1c1ec4b36 00000020:00000080:3.0:1782240001.391195:0:12720:0:(genops.c:906:class_export_put()) final put ffff9bb5f7b69000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1782240001.391199:0:12720:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1782240001.391202:0:12720:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1782240001.391205:0:12720:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1782240001.391207:0:12720:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9bb5f78a0000) has no exports 00000020:00000080:3.0:1782240001.391211:0:12720:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8c5345f1c1ec4b2f 00000020:00000080:3.0:1782240001.391214:0:12720:0:(genops.c:906:class_export_put()) final put ffff9bb5fbba1800/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1782240001.391531:0:12720:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1782240001.391535:0:12720:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1782240001.391537:0:12720:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:3.0:1782240001.391540:0:12720:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1782240001.391542:0:12720:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1782240001.391566:0:12720:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1782240001.391571:0:12720:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1782240001.391595:0:12720:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1782240001.391598:0:12720:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1782240001.391623:0:12720:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8c5345f1c1ec49e6 00000020:00000080:3.0:1782240001.391628:0:12720:0:(genops.c:906:class_export_put()) final put ffff9bb5f499c800/lustre-MDD0000_UUID 00000020:01000000:3.0:1782240001.391632:0:12720:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1782240001.391635:0:12720:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1782240001.391638:0:12720:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1782240001.391640:0:12720:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff9bb5c6bf4d40) has no exports 00000020:00000080:3.0:1782240001.391658:0:12720:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1782240001.391661:0:12720:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1782240001.391664:0:12720:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8c5345f1c1ec49ed 00000020:00000080:3.0:1782240001.391666:0:12720:0:(genops.c:906:class_export_put()) final put ffff9bb5f499c000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1782240001.391673:0:12720:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bb5c8415000 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1782240001.391676:0:12720:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9bb5c8415000 3 00000020:01000004:3.0:1782240001.391679:0:12720:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9bb5c8415000 from lustre-MDT0000 00000020:00000080:3.0:1782240001.391698:0:12720:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1782240001.391701:0:12720:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1782240001.391703:0:12720:0:(genops.c:906:class_export_put()) final put ffff9bb601371800/lustre-MDT0000_UUID 00000020:00000080:3.0:1782240001.391706:0:12720:0:(genops.c:865:class_export_destroy()) destroying export ffff9bb601371800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1782240001.391713:0:12720:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:00000080:0.0:1782240001.391940:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9bb5f4998800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:0.0:1782240001.391945:0:8:0:(genops.c:906:class_export_put()) final put ffff9bb601373000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1782240001.391948:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9bb601373000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1782240001.391951:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:01000004:3.0:1782240001.392371:0:12720:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:3.0:1782240001.392375:0:12720:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1782240001.392378:0:12720:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1782240001.392381:0:12720:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1782240001.392384:0:12720:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1782240001.392390:0:12720:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9bb5dedb2800 7f2dda50-7c13-4c28-a10a-ae40ce7f74f7 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1782240001.392401:0:12720:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff9bb5ded03380) has exports, disconnecting them 00000020:00080000:3.0:1782240001.392405:0:12720:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9bb5dedb2800), last request at 1782239763 00000020:00000080:3.0:1782240001.392419:0:12720:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8c5345f1c1ec498b 00000020:00010000:3.0:1782240001.392423:0:12720:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9bb5dedb2800: total 7 00000100:00080000:3.0:1782240001.392426:0:12720:0:(import.c:65:import_set_state_nolock()) ffff9bb5dedb3800 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1782240001.392712:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9bb5f7cd8800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1782240001.392718:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9bb5cf67f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1782240001.392730:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9bb5fbba7800 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1782240001.392735:0:8:0:(genops.c:906:class_export_put()) final put ffff9bb5f7b6f000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1782240001.392737:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9bb5f7b6f000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1782240001.392764:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1782240001.392798:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9bb5f7b69000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1782240001.392803:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9bb5fbba1800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1782240001.392807:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9bb5fbba5000 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1782240001.392810:0:8:0:(genops.c:906:class_export_put()) final put ffff9bb5f7af9800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1782240001.392812:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9bb5f7af9800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1782240001.392816:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1782240001.392867:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9bb5f499c800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1782240001.392871:0:8:0:(genops.c:906:class_export_put()) final put ffff9bb5cf679800/lustre-MDD0000_UUID 00000020:00000080:0.0:1782240001.392872:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9bb5cf679800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1782240001.392875:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1782240001.393035:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9bb5f499c000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00080000:3.0:1782240001.393258:0:12720:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9bb5dedb2800): rc 0 00000020:00080000:3.0:1782240001.393264:0:12720:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff9bb5ded03380) has no exports 00000100:00100000:3.0:1782240001.393322:0:5785:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9bb5d1f34600:5785] 2 exiting: rc = 0 00000100:00100000:3.0:1782240001.393419:0:5784:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9bb5d81e6800:5784] 1 exiting: rc = 0 00000100:00100000:0.0:1782240001.393519:0:5783:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9bb5d0289200:5783] 0 exiting: rc = 1 00000100:00100000:3.0:1782240001.393659:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240001.393667:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240001.393673:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240001.393679:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240001.393685:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240001.393690:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240001.393694:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240001.393711:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240001.393717:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240001.393724:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240001.393730:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240001.393735:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240001.393771:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240001.393778:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240001.393784:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240001.393789:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240001.393795:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240001.393802:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240001.393807:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240001.393812:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240001.393819:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240001.393824:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240001.393830:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240001.393835:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240001.393850:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240001.393855:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240001.393861:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240001.393866:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240001.393872:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240001.393876:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240001.393882:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240001.393887:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240001.393892:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240001.393897:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240001.393901:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240001.393907:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240001.393912:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240001.393918:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240001.393935:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240001.393941:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240001.393947:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240001.393952:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240001.393957:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240001.393962:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240001.393967:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240001.393972:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240001.393978:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240001.393982:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240001.393987:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240001.393992:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240001.393997:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240001.394002:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240001.394007:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240001.394022:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240001.394028:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240001.394033:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240001.394039:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240001.394044:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240001.394049:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240001.394061:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240001.394066:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240001.394072:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240001.394289:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240001.394297:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:3.0:1782240001.394646:0:12720:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1782240001.394649:0:12720:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00010000:00010000:3.0:1782240001.395662:0:12720:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff9bb5c2a45000/0x8c5345f1c1ec4aa3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x8c5345f1c1ec4a9c expref: 9 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240001.395684:0:12720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb5c2a45000/0x8c5345f1c1ec4aa3 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x8c5345f1c1ec4a9c expref: 9 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240001.395700:0:12720:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff9bb5c1677400/0x8c5345f1c1ec4c8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x8c5345f1c1ec4c86 expref: 8 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240001.395721:0:12720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb5c1677400/0x8c5345f1c1ec4c8d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x8c5345f1c1ec4c86 expref: 8 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240001.395730:0:12720:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff9bb602045e00/0x8c5345f1c1ec4c9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x8c5345f1c1ec4c94 expref: 7 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240001.395737:0:12720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb602045e00/0x8c5345f1c1ec4c9b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x8c5345f1c1ec4c94 expref: 7 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240001.395775:0:12720:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff9bb602044200/0x8c5345f1c1ec4ca9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x8c5345f1c1ec4ca2 expref: 6 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240001.395784:0:12720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb602044200/0x8c5345f1c1ec4ca9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x8c5345f1c1ec4ca2 expref: 6 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240001.395792:0:12720:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff9bb5c2a45200/0x8c5345f1c1ec4cb7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x8c5345f1c1ec4cb0 expref: 5 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240001.395809:0:12720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb5c2a45200/0x8c5345f1c1ec4cb7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x8c5345f1c1ec4cb0 expref: 5 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240001.395818:0:12720:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff9bb5c0031200/0x8c5345f1c1ec4ce1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x8c5345f1c1ec4cda expref: 4 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240001.395824:0:12720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb5c0031200/0x8c5345f1c1ec4ce1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x8c5345f1c1ec4cda expref: 4 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240001.395835:0:12720:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff9bb5c2a44a00/0x8c5345f1c1ec4ee0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x8c5345f1c1ec4ed9 expref: 3 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240001.395844:0:12720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb5c2a44a00/0x8c5345f1c1ec4ee0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x8c5345f1c1ec4ed9 expref: 3 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240001.395853:0:12720:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff9bb5c2a45e00/0x8c5345f1c1ec4eee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x8c5345f1c1ec4ee7 expref: 2 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240001.395860:0:12720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb5c2a45e00/0x8c5345f1c1ec4eee lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x8c5345f1c1ec4ee7 expref: 2 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00010000:1.0:1782240001.396231:0:12721:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9bb5dedb2800: total 0 00010000:00010000:0.0:1782240001.396320:0:12721:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9bb5dedb2800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1782240001.396333:0:12721:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9bb5dedb2800, canceled 0 locks, left on hash table 0. 00000020:00000080:0.0:1782240001.396341:0:12721:0:(genops.c:906:class_export_put()) final put ffff9bb5dedb2800/7f2dda50-7c13-4c28-a10a-ae40ce7f74f7 00010000:00010000:0.0:1782240001.396360:0:12721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782240001.396362:0:12721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782240001.396365:0:12721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782240001.396399:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9bb5dedb2800/7f2dda50-7c13-4c28-a10a-ae40ce7f74f7 for MGS 00000020:00000080:3.0:1782240001.396435:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9bb5dedb3800 for MGS 00000001:00100000:1.0:1782240001.894736:0:7493:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1782240001.894782:0:7493:0:(genops.c:906:class_export_put()) final put ffff9bb601374000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1782240001.894870:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9bb601374000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1782240001.894923:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9bb601377000 for lustre-OST0001 00010000:00010000:0.0:1782240002.271367:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782240003.294979:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1782240003.422902:0:12720:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9bb5f788f9c0 - data ffff9bb5ff861510/ffff9bb5f7f3bc00 00000020:01000000:3.0:1782240003.423136:0:12720:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9bb5d80e8960 - data ffff9bb5f03fe000/ffff9bb5dedd0400 00000020:00000080:3.0:1782240003.423958:0:12720:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8c5345f1c1ec496f 00000020:00000080:3.0:1782240003.423980:0:12720:0:(genops.c:906:class_export_put()) final put ffff9bb5f2648800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1782240003.423999:0:12720:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bb5c8415000 from MGS, refs=2 00000020:01000004:3.0:1782240003.424003:0:12720:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9bb5c8415000 2 00000020:01000004:3.0:1782240003.424006:0:12720:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9bb5c8415000 from MGS 00000020:00000080:1.0:1782240003.424674:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9bb5f2648800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1782240003.424741:0:12720:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1782240003.424768:0:12720:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1782240003.424772:0:12720:0:(genops.c:906:class_export_put()) final put ffff9bb5f2648000/MGS 00000020:00000080:3.0:1782240003.424775:0:12720:0:(genops.c:865:class_export_destroy()) destroying export ffff9bb5f2648000/MGS for MGS 00000020:01000000:3.0:1782240003.424781:0:12720:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1782240003.424834:0:12720:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1782240003.424838:0:12720:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1782240003.424843:0:12720:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1782240003.424850:0:12720:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9bb5f3908000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1782240003.424856:0:12720:0:(genops.c:1574:class_disconnect_exports()) OBD device 8 (ffff9bb5c6bf3380) has exports, disconnecting them 00000020:00080000:3.0:1782240003.424860:0:12720:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9bb5f3908000), last request at 1782239764 00000020:00000080:3.0:1782240003.424864:0:12720:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8c5345f1c1ec4a3a 00000020:00080000:3.0:1782240003.424872:0:12720:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9bb5f3908000): rc 0 00000020:00000080:3.0:1782240003.424876:0:12720:0:(genops.c:906:class_export_put()) final put ffff9bb5f3908000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1782240003.425120:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9bb5f3908000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1782240003.439440:0:12720:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1782240003.439449:0:12720:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1782240003.439454:0:12720:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1782240003.439461:0:12720:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1782240003.439906:0:12720:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1782240003.439917:0:12720:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1782240003.439923:0:12720:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9bb5c8415000 1 00000020:00000080:2.0:1782240003.439930:0:12720:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8c5345f1c1ec4961 00000020:00000080:2.0:1782240003.439937:0:12720:0:(genops.c:906:class_export_put()) final put ffff9bb5f264b800/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1782240003.439942:0:12720:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1782240003.439948:0:12720:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1782240003.439952:0:12720:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1782240003.439955:0:12720:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff9bb5d1bd8000) has no exports 00000020:00000080:1.0:1782240003.440457:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9bb6013aa000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1782240003.440466:0:8:0:(genops.c:906:class_export_put()) final put ffff9bb5f499e800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1782240003.440480:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9bb5f499e800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1782240003.440486:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1782240003.440542:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9bb5f264b800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1782240003.576014:0:12720:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1782240003.576035:0:12720:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1782240003.576041:0:12720:0:(genops.c:906:class_export_put()) final put ffff9bb5cfd00000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1782240003.576046:0:12720:0:(genops.c:865:class_export_destroy()) destroying export ffff9bb5cfd00000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1782240003.576056:0:12720:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1782240003.576191:0:12720:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff9bb5c8416000 00000020:01000000:3.0:1782240003.576212:0:12720:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1782240003.576216:0:12720:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1782240003.576220:0:12720:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1782240003.576224:0:12720:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff9bb5dee3b380) has no exports 00000100:00100000:3.0:1782240003.576317:0:5792:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9bb5cf43dc00:5792] 2 exiting: rc = 0 00000100:00100000:3.0:1782240003.576412:0:5791:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9bb5cb300a00:5791] 1 exiting: rc = 0 00000100:00100000:2.0:1782240003.591908:0:5790:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9bb5cb301600:5790] 0 exiting: rc = 1 00000100:00100000:2.0:1782240003.592395:0:6611:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9bb5f7867e00:6611] 3 exiting: rc = 0 00000100:00100000:3.0:1782240003.592541:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240003.592561:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240003.592568:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240003.592574:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240003.592579:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240003.592585:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240003.592590:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240003.592596:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240003.592601:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240003.592610:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240003.592615:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240003.592620:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240003.592625:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240003.592630:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240003.592635:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240003.592640:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240003.592646:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240003.592650:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240003.592656:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240003.592662:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240003.592667:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240003.592673:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240003.592678:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240003.592684:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240003.592690:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240003.592694:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240003.592700:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240003.592706:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240003.592712:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240003.592717:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240003.592722:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240003.597915:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240003.597925:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240003.597930:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240003.597936:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240003.597944:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240003.597968:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240003.597973:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240003.597979:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240003.597985:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240003.597990:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240003.598112:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240003.598121:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240003.598127:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240003.598133:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240003.598138:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240003.598144:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240003.598150:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240003.598155:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240003.598161:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240003.598166:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240003.598173:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240003.598178:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240003.598184:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240003.598189:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240003.598194:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240003.598201:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240003.598206:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240003.598212:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240003.598218:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240003.598223:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240003.598229:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240003.598234:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240003.598240:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.623650:0:5793:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9bb5c505bc00:5793] 0 exiting: rc = 1 00000100:00100000:0.0:1782240003.638340:0:5794:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9bb5cf439a00:5794] 1 exiting: rc = 0 00000100:00100000:1.0:1782240003.638508:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.638516:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.638524:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.638529:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.638535:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.638542:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.638548:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.638554:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.638560:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.638565:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.638571:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.638577:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.638584:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.638589:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.638600:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.638605:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.638610:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.638616:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.638621:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.638626:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.638631:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.638636:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.638642:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.638647:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.638652:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.638657:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.638661:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.638684:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.638690:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.638694:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.638700:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.638704:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.638709:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.638714:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.638720:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.638734:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.638740:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.638782:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.638790:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.638795:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.638799:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.638804:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.638809:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.638813:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.638819:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.638824:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.638829:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.638834:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.638839:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.638844:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.638849:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.638855:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.638861:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.638866:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.638871:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.638876:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.638881:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.638885:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.638890:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.638895:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.638900:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.638905:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.638919:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.638924:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782240003.646333:0:5796:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9bb5cf435400:5796] 1 exiting: rc = 0 00000100:00100000:2.0:1782240003.648453:0:5795:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9bb5cf434800:5795] 0 exiting: rc = 1 00000100:00100000:1.0:1782240003.648626:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.648650:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.648657:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.648663:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.648669:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.648675:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.648682:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.648688:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.648693:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.648699:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.648716:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.648722:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.648738:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.648744:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.648782:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.648787:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.648793:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.648800:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.648805:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.648811:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.648816:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.648822:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.648842:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.648849:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.648854:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.648860:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.648866:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.648872:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.648877:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.648883:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.648889:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.648895:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.648901:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.648920:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.648938:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.648943:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.648949:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.648954:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.648959:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.648964:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.648969:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.648974:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.648979:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.648984:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.648989:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.648994:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.649031:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.649038:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.649043:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.649048:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.649054:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.649059:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.649064:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.649069:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.649082:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.649088:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.649093:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.649100:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.649118:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.649124:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.649130:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.649137:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.649144:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.649149:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240003.673184:0:5798:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9bb5cf432600:5798] 1 exiting: rc = 0 00000100:00100000:1.0:1782240003.673375:0:5797:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9bb5cf42ce00:5797] 0 exiting: rc = 1 00000100:00100000:2.0:1782240003.673492:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.673500:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.673506:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.673512:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.673519:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.673524:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.673530:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.673536:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.673542:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.673561:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.673567:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.673572:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.673577:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.673583:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.673588:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.673593:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.673610:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.673616:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.673621:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.673626:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.673632:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.673637:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.673642:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.673648:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.673652:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.673657:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.673662:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.673667:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.673673:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.673678:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.673684:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.673690:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.673695:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.673701:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.673707:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.673712:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.673717:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.673722:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.673740:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.673745:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.673792:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.673797:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.673801:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.673806:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.673817:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.673822:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.673827:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.673832:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.673836:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.673842:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.673848:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.673853:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.673858:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.673862:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.673867:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.673871:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.673875:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.673880:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.673885:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.673889:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.673893:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.673898:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.673903:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.673908:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240003.674398:0:5799:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9bb5cf43d400:5799] 0 exiting: rc = 1 00000100:00100000:1.0:1782240003.674559:0:5800:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9bb5cf43d200:5800] 1 exiting: rc = 0 00000100:00100000:2.0:1782240003.674993:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.675016:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.675022:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.675028:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.675034:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.675040:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.675045:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.675051:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.675056:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.675061:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.675067:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.675072:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.675077:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.675082:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.675087:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.675102:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.675107:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.675113:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.675119:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.675124:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.675130:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.675136:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.675141:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.675147:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.675152:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.675158:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.675164:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.675169:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.675174:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.675180:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.675185:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.675190:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.675195:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.675201:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.675206:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.675212:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.675217:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.675222:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.675228:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.675234:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.675240:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.675245:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.675250:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.675256:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.675261:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.675267:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.675272:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.675277:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.675282:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.675288:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.675300:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.675305:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.675311:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.675316:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.675322:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.675327:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.675333:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.675337:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.675341:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.675346:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.675350:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.675355:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.675360:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.675365:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240003.675821:0:5802:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9bb5cf43d800:5802] 1 exiting: rc = 0 00000100:00100000:1.0:1782240003.676169:0:5801:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9bb5cf43c600:5801] 0 exiting: rc = 1 00000100:00100000:2.0:1782240003.680620:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.680631:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.680637:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.680642:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.680648:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.680654:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.680659:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.680665:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.680672:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.680678:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.680683:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.680688:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.680694:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.680700:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.680705:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.680711:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.680716:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.680722:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.680738:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.680744:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.680777:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.680802:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.680807:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.680812:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.680818:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.680824:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.680829:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.680834:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.680839:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.680844:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.680850:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.680855:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.680859:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.680863:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.680869:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.680874:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.680879:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.680884:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.680889:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.680894:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.680900:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.680904:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.680909:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.680914:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.680920:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.680925:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.680930:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.680935:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.680940:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.680944:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.680949:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.680955:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.680960:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.680965:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.680970:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.680975:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.680988:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.680993:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.681216:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.681222:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.681226:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.681230:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.681235:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782240003.681240:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240003.687352:0:5803:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9bb5cf432a00:5803] 0 exiting: rc = 1 00000100:00100000:2.0:1782240003.687967:0:5805:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9bb5cf432200:5805] 2 exiting: rc = 0 00000100:00100000:3.0:1782240003.691463:0:5804:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9bb5cf432c00:5804] 1 exiting: rc = 0 00000100:00100000:0.0:1782240003.693254:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782240003.693264:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782240003.693270:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782240003.693292:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782240003.693320:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782240003.693327:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782240003.693333:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782240003.693352:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782240003.693357:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782240003.693362:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782240003.693367:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782240003.693374:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782240003.693380:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782240003.693386:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782240003.693392:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782240003.693398:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782240003.693403:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782240003.693409:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782240003.693414:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782240003.693419:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782240003.693424:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782240003.693431:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782240003.693436:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782240003.693442:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782240003.693447:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782240003.693452:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782240003.693458:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782240003.693464:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782240003.696955:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782240003.696973:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782240003.696979:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782240003.696984:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782240003.696994:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782240003.696999:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782240003.697061:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782240003.697069:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782240003.697075:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782240003.697080:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782240003.697099:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782240003.697107:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782240003.697114:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782240003.697119:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782240003.697124:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782240003.697129:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782240003.697135:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782240003.697140:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782240003.697144:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782240003.697150:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782240003.697155:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782240003.697160:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782240003.697165:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782240003.697171:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782240003.697192:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782240003.697199:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782240003.697204:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782240003.697209:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782240003.697216:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782240003.697222:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782240003.697228:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782240003.697233:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782240003.697238:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782240003.697244:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782240003.697250:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782240003.697255:0:12720:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1782240003.711407:0:12720:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1782240003.711419:0:12720:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1782240003.711424:0:12720:0:(genops.c:906:class_export_put()) final put ffff9bb5dec82800/MDS_uuid 00000020:00000080:2.0:1782240003.711428:0:12720:0:(genops.c:865:class_export_destroy()) destroying export ffff9bb5dec82800/MDS_uuid for MDS 00000020:01000000:2.0:1782240003.711438:0:12720:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1782240003.711836:0:12720:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1782240004.325410:0:12721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782240005.344349:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782240005.407393:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782240005.407503:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782240005.407523:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fbe0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1868813758978816:0@lo:400:kworker.0 00000400:00000100:3.0:1782240005.407589:0:3306:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1868813758978816 offset 0 length 224: 4 00000100:00100000:0.0:1782240005.410124:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fbe09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3307:1868813758978688:0@lo:400:kworker.0 00000400:00000100:0.0:1782240005.410187:0:3307:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1868813758978688 offset 0 length 224: 4 00000100:00100000:2.0:1782240005.418548:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fbe09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1868813758978944:0@lo:400:kworker.0 00000400:00000100:2.0:1782240005.418603:0:3304:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1868813758978944 offset 0 length 224: 4 00000001:00100000:0.0:1782240005.480268:0:6614:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1782240005.480278:0:6614:0:(genops.c:906:class_export_put()) final put ffff9bb5f460d800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1782240005.485136:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9bb5f460d800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1782240005.485205:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9bb5f460e800 for lustre-OST0000 00010000:00010000:3.0:1782240006.368381:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1782240007.174007:0:12875:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1782240007.203869:0:12875:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1782240007.203922:0:12875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5c0030400/0x8c5345f1c1ec4ca2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4ca9 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240007.203936:0:12875:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5c0030400/0x8c5345f1c1ec4ca2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c5345f1c1ec4ca9 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240007.203944:0:12875:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5c0030400/0x8c5345f1c1ec4ca2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x8c5345f1c1ec4ca9 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240007.203950:0:12875:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.132@tcp lock: ffff9bb5c0030400/0x8c5345f1c1ec4ca2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x8c5345f1c1ec4ca9 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240007.203968:0:12875:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1782240007.204100:0:12875:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1782240007.204144:0:12875:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1782240007.204154:0:12875:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bb5fbe0b800 x1868813758978816/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782240021 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782240007.204289:0:12875:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1782240007.204295:0:12875:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1782240007.204319:0:12875:0:(import.c:65:import_set_state_nolock()) ffff9bb5f7b6a800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1782240007.204923:0:12721:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782240007.205190:0:12721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.132@tcp lock: ffff9bb5c0030400/0x8c5345f1c1ec4ca2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x8c5345f1c1ec4ca9 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240007.205203:0:12721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5c0030400 already unused, calling callback (ffffffffc1d0cc20) 10000000:00010000:0.0:1782240007.205207:0:12721:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.132@tcp lock: ffff9bb5c0030400/0x8c5345f1c1ec4ca2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x8c5345f1c1ec4ca9 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240007.205217:0:12721:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.132@tcp lock: ffff9bb5c0030400/0x8c5345f1c1ec4ca2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x8c5345f1c1ec4ca9 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782240007.205225:0:12721:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.132@tcp lock: ffff9bb5c0030400/0x8c5345f1c1ec4ca2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x8c5345f1c1ec4ca9 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782240007.205231:0:12721:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1782240007.205234:0:12721:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1782240007.205236:0:12721:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1782240007.205265:0:12721:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.132@tcp lock: ffff9bb5c0030400/0x8c5345f1c1ec4ca2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x8c5345f1c1ec4ca9 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240007.205271:0:12721:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782240007.205296:0:12721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.132@tcp lock: ffff9bb5c0030400/0x8c5345f1c1ec4ca2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x8c5345f1c1ec4ca9 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240007.205303:0:12721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.132@tcp lock: ffff9bb5c0030400/0x8c5345f1c1ec4ca2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x8c5345f1c1ec4ca9 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240007.205316:0:12721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782240007.205318:0:12721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782240007.205320:0:12721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782240007.205411:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f77a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3305:1868813758979200:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782240007.205601:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782240007.206153:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fbe0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1868813758978816:0@lo:400:kworker.0 00000100:00100000:2.0:1782240007.206188:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f4896d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1868813758979072:0@lo:39:umount.0 00000400:00000100:2.0:1782240007.206219:0:3303:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1868813758979072 offset 0 length 224: 4 00000100:00100000:0.0:1782240007.206761:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758979200 00000100:00100000:0.0:1782240007.206990:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758979200 00000100:00100000:0.0:1782240007.207085:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1782240007.207094:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f4897480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3305:x1868813758979200:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1782240007.207100:0:5776:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782240007 with bad export cookie 10111502493019818379 00000100:00100000:2.0:1782240007.228404:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f4897480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3305:x1868813758979200:12345-0@lo:103:ldlm_bl.0 Request processed in 21300us (22795us total) trans 0 rc -107/-107 00000100:00100000:2.0:1782240007.228417:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:3.0:1782240007.228488:0:3305:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.132@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1782240007.228504:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9bb5dedb0800 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1782240007.228522:0:3305:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.132@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:3.0:1782240007.242683:0:3305:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.132@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1782240007.242689:0:3305:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1782240007.242713:0:3305:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bb5fbe09500 x1868813758978688/t0(0) o400->MGC192.168.203.132@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1782240021 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782240007.242744:0:3305:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bb5f77a6680 x1868813758979200/t0(0) o103->MGC192.168.203.132@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1782240023 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1782240007.242783:0:3305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1782240007.242786:0:3305:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1782240007.242788:0:3305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1782240007.242792:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9bb5dedb0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1782240007.242798:0:3305:0:(import.c:512:import_select_connection()) MGC192.168.203.132@tcp: connect to NID 0@lo last attempt 142 00000100:00080000:3.0:1782240007.242808:0:3305:0:(import.c:626:import_select_connection()) MGC192.168.203.132@tcp: import ffff9bb5dedb0800 using connection 192.168.203.132@tcp/0@lo 00000100:00100000:0.0:1782240007.242839:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fbe09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3307:1868813758978688:0@lo:400:kworker.0 00000100:00100000:3.0:1782240007.242841:0:3305:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bb5f4896680 x1868813758979328/t0(0) o250->MGC192.168.203.132@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1782240007.242877:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f77a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3305:1868813758979200:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782240007.243173:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f4896680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3303:1868813758979328:0@lo:250:ptlrpcd_00_01.0 00000400:00000100:1.0:1782240007.243229:0:3303:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1868813758979328 offset 0 length 520: 4 00010000:00010000:0.0:1782240007.391153:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782240008.414968:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782240009.439315:0:12721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782240010.463139:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1782240010.528387:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) 7f2dda50-7c13-4c28-a10a-ae40ce7f74f7->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1782240010.528399:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) 7f2dda50-7c13-4c28-a10a-ae40ce7f74f7->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1782240010.528463:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782240010.528498:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f77a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1868813758979456:0@lo:400:kworker.0 00000400:00000100:0.0:1782240010.528549:0:3307:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1868813758979456 offset 0 length 224: 4 00010000:00010000:3.0:1782240011.489558:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782240012.510970:0:12721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1782240012.576343:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) 7f2dda50-7c13-4c28-a10a-ae40ce7f74f7->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1782240012.576354:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) 7f2dda50-7c13-4c28-a10a-ae40ce7f74f7->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1782240012.576480:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782240012.576500:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fbe0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1868813758979584:0@lo:400:kworker.0 00000400:00000100:1.0:1782240012.576553:0:3306:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1868813758979584 offset 0 length 224: 4 00010000:00010000:0.0:1782240013.534985:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782240014.561292:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782240015.585262:0:12721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782240016.607851:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782240017.632117:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782240017.695002:0:3303:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782240007/real 1782240007] req@ffff9bb5f4896680 x1868813758979328/t0(0) o250->MGC192.168.203.132@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1782240017 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1782240017.695026:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) 7f2dda50-7c13-4c28-a10a-ae40ce7f74f7->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1782240017.695034:0:3303:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9bb5f4896680 x1868813758979328/t0(0) o250->MGC192.168.203.132@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1782240017 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782240017.695045:0:3303:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782240007/real 1782240007] req@ffff9bb5f4896d80 x1868813758979072/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1782240017 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1782240017.695068:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) 7f2dda50-7c13-4c28-a10a-ae40ce7f74f7->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1782240017.695079:0:3303:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9bb5f4896d80 x1868813758979072/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1782240017 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1782240017.695110:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9bb5dedb0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1782240017.695129:0:3303:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1782240017.695133:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f4896680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3303:1868813758979328:0@lo:250:ptlrpcd_00_01.0 00000100:00080000:1.0:1782240017.695142:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9bb5f7b6a800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1782240017.695154:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) 7f2dda50-7c13-4c28-a10a-ae40ce7f74f7->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1782240017.695155:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f4896d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1868813758979072:0@lo:39:umount.0 00000100:00080000:2.0:1782240017.695169:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1782240017.695175:0:8:0:(import.c:65:import_set_state_nolock()) ffff9bb5dedb0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1782240017.695259:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fbe09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1868813758979712:0@lo:400:kworker.0 00000400:00000100:3.0:1782240017.695335:0:3304:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1868813758979712 offset 0 length 224: 4 00000100:00080000:3.0:1782240017.695421:0:12875:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1782240017.695427:0:12875:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1782240017.695434:0:12875:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1782240017.697529:0:12875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5c0031400/0x8c5345f1c1ec4cb0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4cb7 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240017.697574:0:12875:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5c0031400/0x8c5345f1c1ec4cb0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c5345f1c1ec4cb7 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240017.697583:0:12875:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5c0031400/0x8c5345f1c1ec4cb0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x8c5345f1c1ec4cb7 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240017.697590:0:12875:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.132@tcp lock: ffff9bb5c0031400/0x8c5345f1c1ec4cb0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x8c5345f1c1ec4cb7 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240017.697629:0:12875:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782240017.697637:0:12875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5c0030c00/0x8c5345f1c1ec4ee7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4eee expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240017.697645:0:12875:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5c0030c00/0x8c5345f1c1ec4ee7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c5345f1c1ec4eee expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240017.697651:0:12875:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5c0030c00/0x8c5345f1c1ec4ee7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x8c5345f1c1ec4eee expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240017.697658:0:12875:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.132@tcp lock: ffff9bb5c0030c00/0x8c5345f1c1ec4ee7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x8c5345f1c1ec4eee expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240017.697680:0:12875:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1782240017.697685:0:12875:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1782240017.697715:0:12875:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1782240017.697720:0:12875:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1782240017.697725:0:12875:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1782240017.697735:0:12875:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1782240017.697741:0:12875:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff9bb5f78a3380) has no exports 00010000:00010000:0.0:1782240017.697790:0:12721:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000020:00080000:3.0:1782240017.697806:0:12875:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff9bb5f78a3380) has no exports 00010000:00010000:0.0:1782240017.697807:0:12721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.132@tcp lock: ffff9bb5c0031400/0x8c5345f1c1ec4cb0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x8c5345f1c1ec4cb7 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240017.697825:0:12721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5c0031400 already unused, calling callback (ffffffffc1d0cc20) 10000000:00010000:0.0:1782240017.697829:0:12721:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.132@tcp lock: ffff9bb5c0031400/0x8c5345f1c1ec4cb0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x8c5345f1c1ec4cb7 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240017.697839:0:12721:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.132@tcp lock: ffff9bb5c0031400/0x8c5345f1c1ec4cb0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x8c5345f1c1ec4cb7 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782240017.697868:0:12721:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.132@tcp lock: ffff9bb5c0031400/0x8c5345f1c1ec4cb0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x8c5345f1c1ec4cb7 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782240017.697874:0:12721:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1782240017.697877:0:12721:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:0.0:1782240017.697880:0:12721:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:0.0:1782240017.697907:0:12721:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9bb5dedb0800 00010000:00010000:0.0:1782240017.697911:0:12721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.132@tcp lock: ffff9bb5c0031400/0x8c5345f1c1ec4cb0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x8c5345f1c1ec4cb7 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240017.697918:0:12721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.132@tcp lock: ffff9bb5c0031400/0x8c5345f1c1ec4cb0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x8c5345f1c1ec4cb7 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240017.697936:0:12721:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782240017.697940:0:12721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.132@tcp lock: ffff9bb5c0030c00/0x8c5345f1c1ec4ee7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x8c5345f1c1ec4eee expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240017.697945:0:12721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5c0030c00 already unused, calling callback (ffffffffc1d0cc20) 10000000:00010000:0.0:1782240017.697948:0:12721:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.132@tcp lock: ffff9bb5c0030c00/0x8c5345f1c1ec4ee7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x8c5345f1c1ec4eee expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240017.697954:0:12721:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.132@tcp lock: ffff9bb5c0030c00/0x8c5345f1c1ec4ee7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x8c5345f1c1ec4eee expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782240017.697960:0:12721:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.132@tcp lock: ffff9bb5c0030c00/0x8c5345f1c1ec4ee7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x8c5345f1c1ec4eee expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782240017.697965:0:12721:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1782240017.697968:0:12721:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1782240017.697976:0:12721:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1782240017.697984:0:12721:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9bb5dedb0800 00010000:00010000:0.0:1782240017.697987:0:12721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.132@tcp lock: ffff9bb5c0030c00/0x8c5345f1c1ec4ee7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x8c5345f1c1ec4eee expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240017.697994:0:12721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.132@tcp lock: ffff9bb5c0030c00/0x8c5345f1c1ec4ee7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x8c5345f1c1ec4eee expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240017.698005:0:12721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782240017.698007:0:12721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782240017.698009:0:12721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1782240017.700499:0:12875:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9bb5f788fa80 - data ffff9bb5f03ea798/ffff9bb5f4634000 00010000:00010000:3.0:1782240017.700581:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1782240017.700739:0:12875:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9bb5d1cfea20 - data ffff9bb5e92495e8/ffff9bb5ee019400 00000100:00080000:2.0:1782240017.702018:0:8:0:(import.c:512:import_select_connection()) MGC192.168.203.132@tcp: connect to NID 0@lo last attempt 386 00000100:00080000:2.0:1782240017.702028:0:8:0:(import.c:591:import_select_connection()) MGC192.168.203.132@tcp: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1782240017.702036:0:8:0:(import.c:626:import_select_connection()) MGC192.168.203.132@tcp: import ffff9bb5dedb0800 using connection 192.168.203.132@tcp/0@lo 00000100:00100000:2.0:1782240017.702082:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bb5fbe0aa00 x1868813758979840/t0(0) o250->MGC192.168.203.132@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1782240017.708224:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fbe0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3303:1868813758979840:0@lo:250:kworker.0 00000400:00000100:1.0:1782240017.708278:0:3303:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1868813758979840 offset 0 length 520: 4 00100000:10000000:3.0:1782240017.715996:0:12875:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1782240017.761685:0:12875:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8c5345f1c1ec4abf 00000020:00000080:2.0:1782240017.761696:0:12875:0:(genops.c:906:class_export_put()) final put ffff9bb5fbba0000/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1782240017.761765:0:12875:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bb5c8863000 from lustre-OST0000, refs=2 00000020:01000004:2.0:1782240017.761769:0:12875:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9bb5c8863000 2 00000020:01000004:2.0:1782240017.761772:0:12875:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9bb5c8863000 from lustre-OST0000 00000020:00000080:2.0:1782240017.761796:0:12875:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1782240017.761805:0:12875:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1782240017.761807:0:12875:0:(genops.c:906:class_export_put()) final put ffff9bb5fbba7000/lustre-OST0000_UUID 00000020:00000080:2.0:1782240017.761810:0:12875:0:(genops.c:865:class_export_destroy()) destroying export ffff9bb5fbba7000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1782240017.761816:0:12875:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1782240017.761866:0:12875:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1782240017.761870:0:12875:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1782240017.761874:0:12875:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1782240017.761878:0:12875:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1782240017.761884:0:12875:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9bb5eddb9000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1782240017.761890:0:12875:0:(genops.c:1574:class_disconnect_exports()) OBD device 12 (ffff9bb5ded04d40) has exports, disconnecting them 00000020:00080000:2.0:1782240017.762199:0:12875:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9bb5eddb9000), last request at 1782239780 00000020:00000080:2.0:1782240017.762204:0:12875:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8c5345f1c1ec4ae9 00000020:00080000:2.0:1782240017.762214:0:12875:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9bb5eddb9000): rc 0 00000020:00000080:2.0:1782240017.762230:0:12875:0:(genops.c:906:class_export_put()) final put ffff9bb5eddb9000/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1782240017.762407:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9bb5fbba0000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1782240017.763343:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9bb5eddb9000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1782240017.763812:0:12875:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1782240017.763817:0:12875:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1782240017.763822:0:12875:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1782240017.763827:0:12875:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1782240017.763964:0:12875:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1782240017.763971:0:12875:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:0.0:1782240017.763976:0:12875:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9bb5c8863000 1 00000020:00000080:0.0:1782240017.763980:0:12875:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8c5345f1c1ec4a79 00000020:00000080:0.0:1782240017.763986:0:12875:0:(genops.c:906:class_export_put()) final put ffff9bb5c8867800/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1782240017.763991:0:12875:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1782240017.763994:0:12875:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1782240017.763998:0:12875:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1782240017.764001:0:12875:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff9bb5ded00000) has no exports 00000020:00000080:1.0:1782240017.764091:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9bb5f7b6a800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1782240017.764097:0:8:0:(genops.c:906:class_export_put()) final put ffff9bb5fc2c6800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1782240017.764100:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9bb5fc2c6800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1782240017.764107:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1782240017.764148:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9bb5c8867800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1782240017.781024:0:12875:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1782240017.781039:0:12875:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1782240017.781043:0:12875:0:(genops.c:906:class_export_put()) final put ffff9bb5c8862800/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1782240017.781058:0:12875:0:(genops.c:865:class_export_destroy()) destroying export ffff9bb5c8862800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1782240017.781065:0:12875:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1782240017.781190:0:12875:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff9bb5c8866000 00000020:02000400:1.0:1782240017.781235:0:12875:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1782240018.657480:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782240019.679178:0:12721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782240020.711941:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1782240021.565864:0:13026:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1782240021.576008:0:13026:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1782240021.576542:0:13026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a45400/0x8c5345f1c1ec4c86 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4c8d expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240021.576560:0:13026:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a45400/0x8c5345f1c1ec4c86 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c5345f1c1ec4c8d expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240021.576569:0:13026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a45400/0x8c5345f1c1ec4c86 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x8c5345f1c1ec4c8d expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240021.576577:0:13026:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a45400/0x8c5345f1c1ec4c86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x8c5345f1c1ec4c8d expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240021.576889:0:13026:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1782240021.576898:0:13026:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1782240021.576933:0:13026:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1782240021.576947:0:13026:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bb5fbe09f80 x1868813758978944/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782240021 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782240021.576980:0:13026:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bb5f77a6680 x1868813758979456/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782240026 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782240021.576995:0:13026:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bb5fbe0b800 x1868813758979584/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782240028 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782240021.577015:0:13026:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bb5fbe09880 x1868813758979712/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782240033 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782240021.577024:0:13026:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1782240021.577031:0:13026:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1782240021.577062:0:13026:0:(import.c:65:import_set_state_nolock()) ffff9bb5f7f23000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1782240021.577140:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fbe0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1868813758979584:0@lo:400:kworker.0 00000100:00100000:1.0:1782240021.577187:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fbe0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1868813758979968:0@lo:39:umount.0 00000400:00000100:1.0:1782240021.577246:0:3303:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1868813758979968 offset 0 length 224: 4 00010000:00010000:0.0:1782240021.577262:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782240021.577272:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a45400/0x8c5345f1c1ec4c86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x8c5345f1c1ec4c8d expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240021.577282:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5c2a45400 already unused, calling callback (ffffffffc1d0cc20) 10000000:00010000:0.0:1782240021.577286:0:5778:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a45400/0x8c5345f1c1ec4c86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x8c5345f1c1ec4c8d expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240021.577313:0:5778:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a45400/0x8c5345f1c1ec4c86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x8c5345f1c1ec4c8d expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782240021.577321:0:5778:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a45400/0x8c5345f1c1ec4c86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x8c5345f1c1ec4c8d expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782240021.577327:0:5778:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1782240021.577330:0:5778:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1782240021.577333:0:5778:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1782240021.577351:0:5778:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9bb5dedb0800 00010000:00010000:0.0:1782240021.577356:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a45400/0x8c5345f1c1ec4c86 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x8c5345f1c1ec4c8d expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240021.577365:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.132@tcp lock: ffff9bb5c2a45400/0x8c5345f1c1ec4c86 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x8c5345f1c1ec4c8d expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782240021.578273:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fbe09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1868813758979712:0@lo:400:kworker.0 00000100:00100000:3.0:1782240021.578288:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fbe09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1868813758978944:0@lo:400:kworker.0 00010000:00010000:0.0:1782240021.578417:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782240021.578420:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782240021.578422:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782240021.578425:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f77a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1868813758979456:0@lo:400:kworker.0 00010000:00010000:0.0:1782240021.728472:0:12721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782240022.751300:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1782240022.814965:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) 7f2dda50-7c13-4c28-a10a-ae40ce7f74f7->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1782240022.814975:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) 7f2dda50-7c13-4c28-a10a-ae40ce7f74f7->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1782240023.775023:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782240024.804046:0:12721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782240025.827301:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782240026.848456:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782240027.872196:0:12721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1782240027.935303:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) 7f2dda50-7c13-4c28-a10a-ae40ce7f74f7->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1782240027.935333:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) 7f2dda50-7c13-4c28-a10a-ae40ce7f74f7->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1782240028.921868:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782240029.983079:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782240031.009380:0:12721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782240031.838928:0:3303:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782240021/real 1782240021] req@ffff9bb5fbe0a680 x1868813758979968/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1782240031 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782240031.838965:0:3303:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9bb5fbe0a680 x1868813758979968/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1782240031 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1782240031.838983:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9bb5f7f23000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1782240031.839009:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fbe0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1868813758979968:0@lo:39:umount.0 00000100:00080000:0.0:1782240031.839166:0:13026:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1782240031.839171:0:13026:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1782240031.839176:0:13026:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1782240031.840201:0:13026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5c0031a00/0x8c5345f1c1ec4c94 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4c9b expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240031.840217:0:13026:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5c0031a00/0x8c5345f1c1ec4c94 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c5345f1c1ec4c9b expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240031.840224:0:13026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5c0031a00/0x8c5345f1c1ec4c94 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x8c5345f1c1ec4c9b expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240031.840230:0:13026:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.132@tcp lock: ffff9bb5c0031a00/0x8c5345f1c1ec4c94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x8c5345f1c1ec4c9b expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240031.840969:0:13026:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782240031.840980:0:13026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5c0031800/0x8c5345f1c1ec4ed9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec4ee0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240031.840990:0:13026:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5c0031800/0x8c5345f1c1ec4ed9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c5345f1c1ec4ee0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240031.840995:0:13026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5c0031800/0x8c5345f1c1ec4ed9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x8c5345f1c1ec4ee0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240031.841001:0:13026:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.132@tcp lock: ffff9bb5c0031800/0x8c5345f1c1ec4ed9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x8c5345f1c1ec4ee0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240031.842903:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782240031.842973:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.132@tcp lock: ffff9bb5c0031a00/0x8c5345f1c1ec4c94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x8c5345f1c1ec4c9b expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240031.842985:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5c0031a00 already unused, calling callback (ffffffffc1d0cc20) 10000000:00010000:3.0:1782240031.842989:0:5779:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.132@tcp lock: ffff9bb5c0031a00/0x8c5345f1c1ec4c94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x8c5345f1c1ec4c9b expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240031.842999:0:5779:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.132@tcp lock: ffff9bb5c0031a00/0x8c5345f1c1ec4c94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x8c5345f1c1ec4c9b expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782240031.843007:0:5779:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.132@tcp lock: ffff9bb5c0031a00/0x8c5345f1c1ec4c94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x8c5345f1c1ec4c9b expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782240031.843034:0:5779:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1782240031.843037:0:5779:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:3.0:1782240031.843049:0:5779:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9bb5dedb0800 00010000:00010000:3.0:1782240031.843053:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.132@tcp lock: ffff9bb5c0031a00/0x8c5345f1c1ec4c94 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x8c5345f1c1ec4c9b expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240031.843061:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.132@tcp lock: ffff9bb5c0031a00/0x8c5345f1c1ec4c94 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x8c5345f1c1ec4c9b expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240031.843078:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782240031.843082:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.132@tcp lock: ffff9bb5c0031800/0x8c5345f1c1ec4ed9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x8c5345f1c1ec4ee0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240031.843088:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5c0031800 already unused, calling callback (ffffffffc1d0cc20) 10000000:00010000:3.0:1782240031.843090:0:5779:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.132@tcp lock: ffff9bb5c0031800/0x8c5345f1c1ec4ed9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x8c5345f1c1ec4ee0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240031.843097:0:5779:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.132@tcp lock: ffff9bb5c0031800/0x8c5345f1c1ec4ed9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x8c5345f1c1ec4ee0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782240031.843104:0:5779:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.132@tcp lock: ffff9bb5c0031800/0x8c5345f1c1ec4ed9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x8c5345f1c1ec4ee0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782240031.843109:0:5779:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1782240031.843112:0:5779:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:3.0:1782240031.843115:0:5779:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9bb5dedb0800 00010000:00010000:3.0:1782240031.843118:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.132@tcp lock: ffff9bb5c0031800/0x8c5345f1c1ec4ed9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x8c5345f1c1ec4ee0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240031.843134:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782240031.843136:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782240031.843138:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782240031.845381:0:13026:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1782240031.845395:0:13026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.132@tcp lock: ffff9bb5c0031800/0x8c5345f1c1ec4ed9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x8c5345f1c1ec4ee0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782240031.845418:0:13026:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:0.0:1782240031.845442:0:13026:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:0.0:1782240031.845445:0:13026:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1782240031.845471:0:13026:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1782240031.845475:0:13026:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1782240031.845481:0:13026:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1782240031.845487:0:13026:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1782240031.845491:0:13026:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9bb5f78a19c0) has no exports 00000020:00080000:0.0:1782240031.845528:0:13026:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9bb5f78a19c0) has no exports 00010000:00010000:3.0:1782240031.845744:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1782240031.850206:0:13026:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9bb5f788fae0 - data ffff9bb5e9000288/ffff9bb5edc9c000 00000020:01000000:0.0:1782240031.850364:0:13026:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9bb5c8348c00 - data ffff9bb4c14bc948/ffff9bb60181d400 00100000:10000000:0.0:1782240031.864516:0:13026:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1782240031.887207:0:13026:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8c5345f1c1ec4b8a 00000020:00000080:0.0:1782240031.887216:0:13026:0:(genops.c:906:class_export_put()) final put ffff9bb5f390c800/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1782240031.887236:0:13026:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bb5eddbf000 from lustre-OST0001, refs=2 00000020:01000004:0.0:1782240031.887239:0:13026:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9bb5eddbf000 2 00000020:01000004:0.0:1782240031.887242:0:13026:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9bb5eddbf000 from lustre-OST0001 00000020:00000080:0.0:1782240031.887263:0:13026:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1782240031.887272:0:13026:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1782240031.887274:0:13026:0:(genops.c:906:class_export_put()) final put ffff9bb5f460a000/lustre-OST0001_UUID 00000020:00000080:0.0:1782240031.887277:0:13026:0:(genops.c:865:class_export_destroy()) destroying export ffff9bb5f460a000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1782240031.887286:0:13026:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1782240031.887387:0:13026:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import 7f2dda50-7c13-4c28-a10a-ae40ce7f74f7->MGS 00010000:00010000:0.0:1782240031.887402:0:13026:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.132@tcp lock: ffff9bb602044800/0x8c5345f1c1ec4a9c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x8c5345f1c1ec4aa3 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782240031.887414:0:13026:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.132@tcp lock: ffff9bb602044800/0x8c5345f1c1ec4a9c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x8c5345f1c1ec4aa3 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782240031.887420:0:13026:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1782240031.887423:0:13026:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1782240031.887426:0:13026:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1782240031.887439:0:13026:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9bb5dedb0800 00010000:00010000:0.0:1782240031.887452:0:13026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.132@tcp lock: ffff9bb602044800/0x8c5345f1c1ec4a9c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x8c5345f1c1ec4aa3 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240031.887467:0:13026:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.132@tcp lock: ffff9bb5ee29f000/0x8c5345f1c1ec4cda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x8c5345f1c1ec4ce1 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782240031.887474:0:13026:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.132@tcp lock: ffff9bb5ee29f000/0x8c5345f1c1ec4cda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x8c5345f1c1ec4ce1 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782240031.887479:0:13026:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1782240031.887481:0:13026:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1782240031.887483:0:13026:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1782240031.887492:0:13026:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9bb5dedb0800 00010000:00010000:0.0:1782240031.887496:0:13026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.132@tcp lock: ffff9bb5ee29f000/0x8c5345f1c1ec4cda lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x8c5345f1c1ec4ce1 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1782240031.887514:0:13026:0:(import.c:65:import_set_state_nolock()) ffff9bb5dedb0800 MGS: changing import state from CONNECTING to CLOSED 00000020:00000080:3.0:1782240031.887592:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9bb5f390c800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 10000000:01000000:0.0:1782240031.887834:0:13026:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1782240031.887838:0:13026:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1782240031.887840:0:13026:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1782240031.887845:0:13026:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1782240031.887855:0:13026:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bb5fbe0aa00 x1868813758979840/t0(0) o250->MGC192.168.203.132@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1782240032 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1782240031.887871:0:13026:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1782240031.887873:0:13026:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 1s for inflight to error out 00000100:00100000:3.0:1782240031.889116:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fbe0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7f2dda50-7c13-4c28-a10a-ae40ce7f74f7:3303:1868813758979840:0@lo:250:kworker.0 10000000:01000000:0.0:1782240031.889178:0:13026:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1782240031.889192:0:13026:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8c5345f1c1ec497d 00000020:00000080:0.0:1782240031.889200:0:13026:0:(genops.c:906:class_export_put()) final put ffff9bb5dec80800/7f2dda50-7c13-4c28-a10a-ae40ce7f74f7 00000020:01000000:0.0:1782240031.889212:0:13026:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGC192.168.203.132@tcp (flags='') 00000020:00000080:0.0:1782240031.889220:0:13026:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1782240031.889225:0:13026:0:(obd_config.c:955:class_cleanup()) MGC192.168.203.132@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1782240031.889229:0:13026:0:(genops.c:1579:class_disconnect_exports()) OBD device 2 (ffff9bb5d1bd99c0) has no exports 00000020:00000080:3.0:1782240031.889255:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9bb5dec80800/7f2dda50-7c13-4c28-a10a-ae40ce7f74f7 for MGC192.168.203.132@tcp 10000000:01000000:3.0:1782240031.890944:0:5787:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1782240031.891442:0:13026:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.203.132@tcp: client import never connected 00000100:00080000:0.0:1782240031.891448:0:13026:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1782240031.891452:0:13026:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1782240031.891456:0:13026:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1782240031.891459:0:13026:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1782240031.891502:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9bb5dedb0800 for MGC192.168.203.132@tcp 00000020:00000080:0.0:1782240031.891553:0:13026:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1782240031.891564:0:13026:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.132@tcp (uuid 7f2dda50-7c13-4c28-a10a-ae40ce7f74f7) 00000020:00000080:0.0:1782240031.891570:0:13026:0:(genops.c:906:class_export_put()) final put ffff9bb5dedb2000/7f2dda50-7c13-4c28-a10a-ae40ce7f74f7 00000020:00000080:0.0:1782240031.891574:0:13026:0:(genops.c:865:class_export_destroy()) destroying export ffff9bb5dedb2000/7f2dda50-7c13-4c28-a10a-ae40ce7f74f7 for MGC192.168.203.132@tcp 00000020:01000000:0.0:1782240031.891580:0:13026:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.132@tcp (7f2dda50-7c13-4c28-a10a-ae40ce7f74f7) 00000020:01000000:0.0:1782240031.892089:0:13026:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1782240031.892095:0:13026:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1782240031.892103:0:13026:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1782240031.892110:0:13026:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9bb5c8860800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1782240031.892114:0:13026:0:(genops.c:1574:class_disconnect_exports()) OBD device 16 (ffff9bb60182b380) has exports, disconnecting them 00000020:00080000:0.0:1782240031.892118:0:13026:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9bb5c8860800), last request at 1782239797 00000020:00000080:0.0:1782240031.892122:0:13026:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8c5345f1c1ec4bb4 00000020:00080000:0.0:1782240031.892136:0:13026:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9bb5c8860800): rc 0 00000020:00000080:0.0:1782240031.892140:0:13026:0:(genops.c:906:class_export_put()) final put ffff9bb5c8860800/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1782240031.892173:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9bb5c8860800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:1.0:1782240031.894952:0:13026:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:1.0:1782240031.894960:0:13026:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1782240031.894965:0:13026:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1782240031.894974:0:13026:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1782240031.895034:0:12721:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00000020:00000080:3.0:1782240031.895227:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9bb5f7f23000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:3.0:1782240031.895635:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:3.0:1782240031.898999:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:3.0:1782240031.901062:0:5773:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9bb5d81e5400:5773] 0 exiting: rc = 1 00000100:00100000:1.0:1782240031.903181:0:5774:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9bb5d81e5200:5774] 1 exiting: rc = 0 00000100:00100000:3.0:1782240031.903569:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240031.904037:0:5775:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9bb5d81e4600:5775] 0 exiting: rc = 1 00000100:00100000:0.0:1782240031.904130:0:7481:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9bb5f7e3ba00:7481] 3 exiting: rc = 0 00000100:00100000:1.0:1782240031.906197:0:5777:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9bb5d81e4a00:5777] 2 exiting: rc = 0 00000100:00100000:3.0:1782240031.907532:0:5776:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9bb5d81e5800:5776] 1 exiting: rc = 0 00000100:00100000:1.0:1782240031.907790:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240031.907807:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240031.907813:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240031.907917:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240031.907924:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240031.907929:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240031.907935:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240031.907941:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240031.907948:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240031.907953:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240031.907961:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240031.907968:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240031.907973:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240031.907984:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240031.908571:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240031.908579:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240031.908586:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240031.908591:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240031.908596:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240031.908601:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240031.908606:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240031.908611:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240031.908616:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240031.908622:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240031.908628:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240031.909097:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240031.909108:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240031.909114:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240031.909122:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240031.909130:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240031.909135:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240031.909255:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240031.909262:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240031.909269:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240031.909274:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240031.909279:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240031.909284:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240031.909288:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240031.909308:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240031.909313:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240031.909319:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240031.909324:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240031.909329:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240031.909334:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240031.909339:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240031.909345:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240031.909351:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240031.909356:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240031.909361:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240031.909365:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240031.909370:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240031.909375:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240031.909379:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240031.909383:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240031.909388:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240031.909392:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240031.909397:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240031.909401:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240031.909406:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240031.909411:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240031.909415:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240031.909420:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240031.909425:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240031.909430:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1782240031.912212:0:13026:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1782240031.912224:0:13026:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1782240031.912230:0:13026:0:(genops.c:906:class_export_put()) final put ffff9bb5f7f20000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1782240031.912235:0:13026:0:(genops.c:865:class_export_destroy()) destroying export ffff9bb5f7f20000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1782240031.912241:0:13026:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:1.0:1782240031.912282:0:13026:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9bb5eddbf000 1 00000020:00000080:1.0:1782240031.912287:0:13026:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8c5345f1c1ec4b59 00000020:00000080:1.0:1782240031.912293:0:13026:0:(genops.c:906:class_export_put()) final put ffff9bb5f7b6d000/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1782240031.912320:0:13026:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1782240031.912324:0:13026:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1782240031.912329:0:13026:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1782240031.912333:0:13026:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff9bb5d1bdb380) has no exports 00000020:00000080:3.0:1782240031.912391:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9bb5f7b6d000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1782240031.971601:0:13026:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1782240031.971616:0:13026:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1782240031.971621:0:13026:0:(genops.c:906:class_export_put()) final put ffff9bb5c70ac800/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1782240031.971626:0:13026:0:(genops.c:865:class_export_destroy()) destroying export ffff9bb5c70ac800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1782240031.971636:0:13026:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1782240031.971991:0:13026:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff9bb5eddba000 00000020:01000000:3.0:1782240031.972015:0:13026:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1782240031.972020:0:13026:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1782240031.972026:0:13026:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1782240031.972030:0:13026:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff9bb5ded019c0) has no exports 00000020:00000080:3.0:1782240031.972058:0:13026:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1782240031.972065:0:13026:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1782240031.972068:0:13026:0:(genops.c:906:class_export_put()) final put ffff9bb5c8863800/OSS_uuid 00000020:00000080:3.0:1782240031.972078:0:13026:0:(genops.c:865:class_export_destroy()) destroying export ffff9bb5c8863800/OSS_uuid for OSS 00000020:01000000:3.0:1782240031.972082:0:13026:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:3.0:1782240031.972104:0:5786:0:(pinger.c:550:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1782240031.972247:0:6589:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9bb5e8db9600:6589] 1 exiting: rc = 0 00000100:00100000:0.0:1782240031.973056:0:8312:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9bb60188de00:8312] 3 exiting: rc = 0 00000100:00100000:0.0:1782240031.973141:0:6588:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9bb5fc0a9800:6588] 0 exiting: rc = 1 00000100:00100000:1.0:1782240031.979007:0:6590:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9bb5e8db9400:6590] 2 exiting: rc = 0 00000100:00100000:3.0:1782240031.979160:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.979168:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.979174:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.979179:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.979185:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.979190:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.979194:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.979198:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.979203:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.979207:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.979212:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.979216:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.979221:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.979226:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.979230:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.979234:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.979238:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.979242:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.979247:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.979251:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.979255:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.979260:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.979264:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.979268:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.979272:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.979276:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.979280:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.979284:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.979289:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.979294:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.979298:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.979313:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.979317:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.979322:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.979326:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.979331:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.979335:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.979340:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.979345:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.979350:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.979355:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.979360:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.979365:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.979370:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.979377:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.979382:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.979387:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.979392:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.979397:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.979403:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.979408:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.979414:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.979419:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.979424:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.979430:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.979435:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.979440:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.979445:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.979450:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.979455:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.979460:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.979465:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.979469:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.979474:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240031.980529:0:6592:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9bb5fc0a9400:6592] 0 exiting: rc = 1 00000100:00100000:1.0:1782240031.980614:0:6593:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9bb5fbe24e00:6593] 1 exiting: rc = 0 00000100:00100000:3.0:1782240031.981080:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.981087:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.981099:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.981105:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.981113:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.981118:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.981122:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.981127:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.981133:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.981138:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.981143:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.981147:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.981152:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.981156:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.981161:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.981165:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.981170:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.981174:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.981178:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.981183:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.981187:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.981192:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.981196:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.981200:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.981205:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.981210:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.981215:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.981219:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.981223:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.981228:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.981232:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.981237:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.981241:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.981245:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.981249:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.981253:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.981258:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.981267:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.981272:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.981276:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.981280:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.981285:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.981289:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.981294:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.981298:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.981302:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.981307:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.981311:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.981316:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.981320:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.981325:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.981334:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.981339:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.981344:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.981349:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.981354:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.981359:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.981364:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.981369:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.981374:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.981379:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.981384:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.981388:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.981399:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.987169:0:6596:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9bb5c6a88600:6596] 2 exiting: rc = 0 00000100:00100000:1.0:1782240031.992242:0:6595:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9bb5fbe25800:6595] 1 exiting: rc = 0 00000100:00100000:1.0:1782240031.994410:0:6594:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9bb5fbe24200:6594] 0 exiting: rc = 1 00000100:00100000:3.0:1782240031.995619:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.995628:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.995634:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.995639:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.995655:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.995661:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.995667:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.995688:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.995694:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.995701:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.995707:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.995712:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.995719:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.995725:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.995731:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.995736:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.995742:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.995768:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.995775:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.995780:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.995787:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.995793:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.995799:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.995804:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.996023:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.996031:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.996037:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.996042:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.996047:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.996052:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.996058:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.996063:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.996069:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.996074:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.996082:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.996089:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.996094:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.996100:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.996105:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.996111:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.996116:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.996121:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.996134:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.996139:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.996145:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.996152:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.996157:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.996163:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.996183:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.996190:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.996197:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.996203:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.996209:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.996215:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.996222:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.996228:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.996234:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.996240:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.996246:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.996253:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.996259:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.996264:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.996270:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240031.996276:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240032.020457:0:6598:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9bb5c6092000:6598] 1 exiting: rc = 0 00000100:00100000:0.0:1782240032.020547:0:6597:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9bb5c6093200:6597] 0 exiting: rc = 1 00000100:00100000:3.0:1782240032.021533:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.021542:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.021548:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.021553:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.021558:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.021564:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.021569:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.021575:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.021581:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.021585:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.021592:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.021598:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.021604:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.023744:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.023771:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.023777:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.023783:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.023788:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.023794:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.023800:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.023805:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.023811:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.023817:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.023822:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.023840:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.023846:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.023851:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.023857:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.023862:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.023868:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.023874:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.023880:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.023885:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.023890:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.023895:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.023900:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.023907:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.023914:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.023921:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.023926:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.023933:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.023937:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.023943:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.023952:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.023961:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.023968:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.023974:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.023979:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.024003:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.024009:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.024015:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.024020:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.024026:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.024032:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.024039:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.024044:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.024050:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.024056:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.024062:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.024068:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.024074:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.024080:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.024086:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.024092:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782240032.024838:0:6600:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9bb5c6093c00:6600] 1 exiting: rc = 0 00000100:00100000:0.0:1782240032.025240:0:6599:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9bb5c6092200:6599] 0 exiting: rc = 1 00000100:00100000:3.0:1782240032.025452:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.025459:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.025464:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.025471:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.025477:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.025483:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.025489:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.025496:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.025528:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.025536:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.025541:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.025547:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.025555:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.025560:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.025567:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.025575:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.025580:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.025586:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.025591:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.025621:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.025652:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.025659:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.025665:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.025671:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.025677:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.025684:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.025690:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.025696:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.025702:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.025708:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.025714:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.025720:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.025742:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.025770:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.025780:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.025787:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.025793:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.025799:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.025806:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.025813:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.025819:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.025936:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.025947:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.025953:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.025975:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.025982:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.025988:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.025994:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.026001:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.026006:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.026013:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.026018:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.026025:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.026031:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.026046:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.026053:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.026075:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.026082:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.026088:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.026095:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.026101:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.026106:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.026113:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782240032.026119:0:13026:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1782240032.049365:0:13026:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1782240053.130850:0:13645:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg332-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1782240062.913512:0:14058:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:2.0:1782240062.913518:0:14058:0:(obd_mount.c:917:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1782240062.913612:0:14058:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9bb5d204d000 00000020:01000004:2.0:1782240062.913627:0:14058:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1782240062.913634:0:14058:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1782240062.913647:0:14058:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9bb5ef7a99c0) 00000020:00000080:2.0:1782240062.913661:0:14058:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1782240062.926185:0:14058:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1782240062.928109:0:14058:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:2.0:1782240062.928454:0:14058:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 515: rc = 0 00100000:10000000:2.0:1782240062.928549:0:14058:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 515: rc = 0 00100000:10000000:2.0:1782240062.929002:0:14058:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1782240062.929079:0:14058:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 515: rc = 0 00100000:10000000:2.0:1782240062.929190:0:14058:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 515: rc = 0 00100000:10000000:2.0:1782240062.929288:0:14058:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 515: rc = 0 00100000:10000000:2.0:1782240062.929391:0:14058:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 515: rc = 0 00100000:10000000:2.0:1782240062.929639:0:14058:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 517: rc = 0 00100000:10000000:2.0:1782240062.930673:0:14058:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 658: rc = 0 00100000:10000000:2.0:1782240062.930925:0:14058:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 658: rc = 0 00100000:10000000:2.0:1782240062.931339:0:14058:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 459: rc = 0 00100000:10000000:2.0:1782240062.931624:0:14058:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 459: rc = 0 00100000:10000000:2.0:1782240062.932034:0:14058:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 459: rc = 0 00100000:10000000:2.0:1782240062.932282:0:14058:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 459: rc = 0 00100000:10000000:2.0:1782240062.932545:0:14058:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 459: rc = 0 00100000:10000000:2.0:1782240062.932966:0:14058:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 459: rc = 0 00100000:10000000:2.0:1782240062.933222:0:14058:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 459: rc = 0 00100000:10000000:2.0:1782240062.933484:0:14058:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 459: rc = 0 00100000:10000000:2.0:1782240062.933900:0:14058:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 459: rc = 0 00100000:10000000:2.0:1782240062.934141:0:14058:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 459: rc = 0 00100000:10000000:2.0:1782240062.934409:0:14058:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 459: rc = 0 00100000:10000000:2.0:1782240062.934658:0:14058:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 459: rc = 0 00100000:10000000:2.0:1782240062.935257:0:14058:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 168: rc = 0 00100000:10000000:2.0:1782240062.935536:0:14058:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 168: rc = 0 00100000:10000000:2.0:1782240062.935874:0:14058:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 168: rc = 0 00100000:10000000:2.0:1782240062.936121:0:14058:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 168: rc = 0 00100000:10000000:2.0:1782240062.936372:0:14058:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 168: rc = 0 00100000:10000000:2.0:1782240062.936627:0:14058:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 168: rc = 0 00100000:10000000:2.0:1782240062.937099:0:14058:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 168: rc = 0 00100000:10000000:2.0:1782240062.937356:0:14058:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 168: rc = 0 00100000:10000000:2.0:1782240062.937605:0:14058:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 168: rc = 0 00100000:10000000:2.0:1782240062.937944:0:14058:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 168: rc = 0 00100000:10000000:2.0:1782240062.938194:0:14058:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 168: rc = 0 00100000:10000000:2.0:1782240062.938454:0:14058:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 168: rc = 0 00100000:10000000:2.0:1782240062.938701:0:14058:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 168: rc = 0 00100000:10000000:2.0:1782240062.939102:0:14058:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 168: rc = 0 00100000:10000000:2.0:1782240062.939361:0:14058:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 168: rc = 0 00100000:10000000:2.0:1782240062.939606:0:14058:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 168: rc = 0 00100000:10000000:2.0:1782240062.939920:0:14058:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 168: rc = 0 00100000:10000000:2.0:1782240062.940178:0:14058:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 168: rc = 0 00100000:10000000:2.0:1782240062.940433:0:14058:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 168: rc = 0 00100000:10000000:2.0:1782240062.940673:0:14058:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 168: rc = 0 00100000:10000000:2.0:1782240062.941098:0:14058:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 168: rc = 0 00100000:10000000:2.0:1782240062.941367:0:14058:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 168: rc = 0 00100000:10000000:2.0:1782240062.941608:0:14058:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 168: rc = 0 00100000:10000000:2.0:1782240062.942050:0:14058:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 168: rc = 0 00100000:10000000:2.0:1782240062.942305:0:14058:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 168: rc = 0 00100000:10000000:2.0:1782240062.942558:0:14058:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 168: rc = 0 00100000:10000000:2.0:1782240062.942898:0:14058:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 168: rc = 0 00100000:10000000:2.0:1782240062.943140:0:14058:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 168: rc = 0 00100000:10000000:2.0:1782240062.943400:0:14058:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 168: rc = 0 00100000:10000000:2.0:1782240062.943656:0:14058:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 168: rc = 0 00100000:10000000:2.0:1782240062.944055:0:14058:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 168: rc = 0 00100000:10000000:2.0:1782240062.944320:0:14058:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 168: rc = 0 00100000:10000000:2.0:1782240062.944662:0:14058:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 667: rc = 0 00100000:10000000:2.0:1782240062.945458:0:14058:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1782240062.945625:0:14058:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 457: rc = 0 00100000:10000000:2.0:1782240062.945930:0:14058:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1782240062.945999:0:14058:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 457: rc = 0 00100000:10000000:2.0:1782240062.946174:0:14058:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1782240062.946244:0:14058:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 457: rc = 0 00100000:10000000:2.0:1782240062.946611:0:14058:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1782240062.946686:0:14058:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 659: rc = 0 00100000:10000000:2.0:1782240062.946951:0:14058:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1782240062.947015:0:14058:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 659: rc = 0 00100000:10000000:2.0:1782240062.947202:0:14058:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1782240062.947269:0:14058:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 659: rc = 0 00000020:00000080:2.0:1782240062.947532:0:14058:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1782240062.947540:0:14058:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1782240062.947549:0:14058:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8c5345f1c1ec5c7e 00000020:01000004:2.0:1782240062.947556:0:14058:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1782240062.947561:0:14058:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1782240062.947566:0:14058:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9bb5d204d000 from MGS 00000020:01000004:2.0:1782240062.947570:0:14058:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1782240062.947579:0:14058:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9bb5ef7acd40) 00000020:00000080:2.0:1782240062.947589:0:14058:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1782240062.947638:0:14058:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bb5d204d000 from MGS, refs=2 00080000:01000000:2.0:1782240062.947643:0:14058:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1782240062.947648:0:14058:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8c5345f1c1ec5c8c 00000100:00100000:2.0:1782240062.947736:0:14058:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1782240062.947982:0:14058:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1782240062.947987:0:14058:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1782240062.948374:0:14058:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1782240062.948381:0:14058:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1782240062.949146:0:14058:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782240062.949275:0:14058:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1782240062.949279:0:14058:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1782240062.949705:0:14058:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1782240062.949712:0:14058:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1782240062.950195:0:14058:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1782240062.950201:0:14058:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1782240062.950861:0:14064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782240062.950864:0:14064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782240062.950866:0:14064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782240062.951192:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782240062.951194:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782240062.951196:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782240062.952019:0:14058:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1782240062.956843:0:14064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1782240062.961983:0:14058:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1782240062.962000:0:14058:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1782240062.962010:0:14058:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1782240062.963335:0:14067:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1782240062.963459:0:14058:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1782240062.963551:0:14058:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1782240062.964143:0:14058:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1782240062.964456:0:14058:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782240062.964593:0:14058:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1782240062.964598:0:14058:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1782240062.966448:0:14058:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1782240062.966457:0:14058:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1782240062.969671:0:14058:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1782240062.969682:0:14058:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1782240062.971279:0:14058:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1782240062.971307:0:14058:0:(obd_mount.c:402:lustre_start_mgc()) Start MGC 'MGC192.168.203.132@tcp' 00000020:01000004:2.0:1782240062.971309:0:14058:0:(obd_mount.c:411:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1782240062.971336:0:14058:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGC192.168.203.132@tcp (typ=mgc) 00000020:00000080:2.0:1782240062.971348:0:14058:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.132@tcp (ffff9bb5ef7ab380) 00000020:00000080:2.0:1782240062.971361:0:14058:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1782240062.971432:0:14058:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bb5f7af8800@MGC192.168.203.132@tcp: add connection 192.168.203.132@tcp at head 00010000:00010000:2.0:1782240062.971575:0:14058:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.132@tcp-0 is initialized 00000040:01000000:2.0:1782240062.971581:0:14058:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.132@tcp ctxt 1 is initialized 00000100:00080000:0.0:1782240062.974590:0:14072:0:(pinger.c:468:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1782240062.978929:0:14073:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1782240062.980128:0:14058:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.132@tcp (uuid 8bfa1ba2-9083-4509-bfe8-a04280fb1c10) 00000020:00000080:2.0:1782240062.980152:0:14058:0:(genops.c:1406:class_connect()) connect: client 8bfa1ba2-9083-4509-bfe8-a04280fb1c10, cookie 0x8c5345f1c1ec5c9a 00000100:00080000:2.0:1782240062.980216:0:14058:0:(import.c:512:import_select_connection()) MGC192.168.203.132@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1782240062.980224:0:14058:0:(import.c:626:import_select_connection()) MGC192.168.203.132@tcp: import ffff9bb5f7af8800 using connection 192.168.203.132@tcp/0@lo 00000100:00100000:2.0:1782240062.980257:0:14058:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bb5fbe0a680 x1868813758980096/t0(0) o250->MGC192.168.203.132@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1782240062.980323:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fbe0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:3303:1868813758980096:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1782240062.980386:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1782240062.980433:0:14058:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import 8bfa1ba2-9083-4509-bfe8-a04280fb1c10->MGS 00000020:01000004:2.0:1782240062.980457:0:14058:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1782240062.980462:0:14058:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1782240062.980475:0:14058:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9bb5ef7a8000) 00000020:00000080:2.0:1782240062.980486:0:14058:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1782240062.981798:0:14068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758980096 00000100:00100000:0.0:1782240062.981815:0:14068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758980096 00000100:00100000:0.0:1782240062.981850:0:14068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782240062.981858:0:14068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7b04050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3303:x1868813758980096:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1782240062.981882:0:14068:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 8bfa1ba2-9083-4509-bfe8-a04280fb1c10@0@lo t0 exp 0000000000000000 cur 442 last 0 00000020:00000080:0.0:1782240062.981907:0:14068:0:(genops.c:1406:class_connect()) connect: client 8bfa1ba2-9083-4509-bfe8-a04280fb1c10, cookie 0x8c5345f1c1ec5ca8 00000100:00080000:0.0:1782240062.982025:0:14068:0:(import.c:65:import_set_state_nolock()) ffff9bb5d1dce800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782240062.982141:0:14068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7b04050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+5:3303:x1868813758980096:12345-0@lo:250:mount.lustre.0 Request processed in 282us (1753us total) trans 0 rc 0/0 00000100:00100000:0.0:1782240062.982148:0:14068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782240062.982901:0:3303:0:(client.c:3111:ptlrpc_free_committed()) MGC192.168.203.132@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1782240062.982911:0:3303:0:(import.c:1134:ptlrpc_connect_interpret()) MGC192.168.203.132@tcp: connect to target with instance 0 00000100:00080000:3.0:1782240062.982919:0:3303:0:(import.c:961:ptlrpc_connect_set_flags()) MGC192.168.203.132@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1782240062.982935:0:3303:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1782240062.982939:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9bb5f7af8800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1782240062.982943:0:3303:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1782240062.982958:0:3303:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1782240062.982965:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fbe0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:3303:1868813758980096:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1782240062.992401:0:14058:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782240062.997081:0:14058:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1782240062.997096:0:14058:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1782240062.998060:0:14058:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1782240062.998068:0:14058:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1782240062.999235:0:14058:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1782240062.999243:0:14058:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1782240063.001151:0:14058:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782240063.001324:0:14058:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1782240063.001331:0:14058:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1782240063.004148:0:14058:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1782240063.004162:0:14058:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1782240063.104850:0:14058:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1782240063.105032:0:14058:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1782240063.105038:0:14058:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1782240063.106473:0:14058:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1782240063.106484:0:14058:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1782240063.107611:0:14058:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782240063.107976:0:14058:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1782240063.107982:0:14058:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1782240063.108953:0:14058:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1782240063.108961:0:14058:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1782240063.109633:0:14058:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1782240063.110006:0:14058:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1782240063.110012:0:14058:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1782240063.110684:0:14058:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1782240063.110692:0:14058:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1782240063.111635:0:14058:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1782240063.112407:0:14058:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1782240063.112415:0:14058:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1782240063.113063:0:14058:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1782240063.113072:0:14058:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1782240063.147242:0:14058:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1782240063.147578:0:14058:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1782240063.147586:0:14058:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1782240063.154070:0:14058:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1782240063.154083:0:14058:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1782240063.155220:0:14058:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1782240063.155229:0:14058:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1782240063.158614:0:14058:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1782240063.158643:0:14058:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1782240063.158650:0:14058:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.132@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1782240063.158988:0:14058:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.132@tcp ctxt 0 is initialized 00000020:01000004:3.0:1782240063.159022:0:14058:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.132@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1782240063.159027:0:14058:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1782240063.159029:0:14058:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1782240063.159030:0:14058:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782240063.159031:0:14058:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782240063.159032:0:14058:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782240063.159033:0:14058:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782240063.159035:0:14058:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1782240063.159036:0:14058:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1782240063.159038:0:14058:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782240063.159039:0:14058:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1782240063.159042:0:14058:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1782240063.159044:0:14058:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1782240063.159046:0:14058:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1782240063.159047:0:14058:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782240063.159048:0:14058:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782240063.159049:0:14058:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782240063.159050:0:14058:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782240063.159051:0:14058:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1782240063.159052:0:14058:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1782240063.159053:0:14058:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782240063.159054:0:14058:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1782240063.159078:0:14058:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1782240063.159100:0:14058:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f4895880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14058:1868813758980224:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1782240063.159279:0:14058:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782240063.159445:0:14058:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5d1cab600 going to sleep for 11 seconds 00000100:00100000:0.0:1782240063.159598:0:14071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758980224 00000100:00100000:0.0:1782240063.159605:0:14071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758980224 00000100:00100000:0.0:1782240063.159688:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782240063.159697:0:14071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7b07450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+5:14058:x1868813758980224:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1782240063.159734:0:14071:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1782240063.159737:0:14071:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1782240063.159741:0:14071:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1782240063.160171:0:14092:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1782240063.160908:0:14071:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:1.0:1782240063.163064:0:14093:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1782240063.163072:0:14093:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1782240063.163074:0:14093:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1782240063.163112:0:14093:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:0.0:1782240063.163664:0:14071:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1782240063.163675:0:14071:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1782240063.183282:0:14071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7b07450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+5:14058:x1868813758980224:12345-0@lo:253:mount.lustre.0 Request processed in 23578us (24037us total) trans 0 rc 0/0 00000100:00100000:0.0:1782240063.183306:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782240063.183467:0:14058:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f4895880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14058:1868813758980224:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1782240063.183482:0:14058:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1782240063.183485:0:14058:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1782240063.183487:0:14058:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1782240063.183488:0:14058:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782240063.183489:0:14058:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782240063.183490:0:14058:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782240063.183492:0:14058:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782240063.183493:0:14058:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1782240063.183494:0:14058:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1782240063.183496:0:14058:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782240063.183497:0:14058:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1782240063.183526:0:14058:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9bb5d204d000 from lustre-MDT0000 10000000:01000000:3.0:1782240063.183549:0:14058:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1782240063.183553:0:14058:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1782240063.183557:0:14058:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9bb5ef7ab380 10000000:01000000:3.0:1782240063.183569:0:14058:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1782240063.183577:0:14058:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff9bb5ef7ab380 from 1 10000000:01000000:3.0:1782240063.183580:0:14058:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1782240063.183614:0:14058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e26a00/0x8c5345f1c1ec5caf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240063.183626:0:14058:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e26a00/0x8c5345f1c1ec5caf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240063.183635:0:14058:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e26a00/0x8c5345f1c1ec5caf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782240063.183654:0:14058:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f4895880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14058:1868813758980352:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1782240063.183706:0:14058:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782240063.183786:0:14058:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5d1cab9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782240063.184082:0:14070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758980352 00000100:00100000:0.0:1782240063.184088:0:14070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758980352 00000100:00100000:0.0:1782240063.184130:0:14070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1782240063.184138:0:14070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7b04c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+5:14058:x1868813758980352:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1782240063.184151:0:14070:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782240063.184164:0:14070:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb5f4436c00/0x8c5345f1c1ec5cb6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c5345f1c1ec5caf expref: -99 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240063.184188:0:14070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb5f4436c00/0x8c5345f1c1ec5cb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c5345f1c1ec5caf expref: 6 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240063.184198:0:14070:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb5f4436c00/0x8c5345f1c1ec5cb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c5345f1c1ec5caf expref: 6 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240063.184207:0:14070:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5f4436c00, rc 0) 00000100:00100000:0.0:1782240063.185929:0:14070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7b04c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+6:14058:x1868813758980352:12345-0@lo:101:mount.lustre.0 Request processed in 1654us (2085us total) trans 0 rc 0/0 00000100:00100000:0.0:1782240063.185940:0:14070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1782240063.187177:0:14058:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f4895880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14058:1868813758980352:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1782240063.187205:0:14058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e26a00/0x8c5345f1c1ec5caf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec5cb6 expref: -99 pid: 14058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240063.187217:0:14058:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e26a00/0x8c5345f1c1ec5caf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c5345f1c1ec5cb6 expref: -99 pid: 14058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782240063.187306:0:14058:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f4895880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14058:1868813758980480:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782240063.187450:0:14058:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782240063.187477:0:14058:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5d1cab9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782240063.187744:0:14071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758980480 00000100:00100000:0.0:1782240063.187774:0:14071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758980480 00000100:00100000:0.0:1782240063.187924:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1782240063.187933:0:14071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7b05050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+6:14058:x1868813758980480:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782240063.188169:0:14071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7b05050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+6:14058:x1868813758980480:12345-0@lo:501:mount.lustre.0 Request processed in 226us (708us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782240063.188177:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1782240063.188527:0:14058:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f4895880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14058:1868813758980480:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1782240063.188551:0:14058:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1782240063.188676:0:14058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e26a00/0x8c5345f1c1ec5caf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec5cb6 expref: -99 pid: 14058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240063.188686:0:14058:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e26a00/0x8c5345f1c1ec5caf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec5cb6 expref: -99 pid: 14058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782240063.188693:0:14058:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9bb5d204d000 10000000:01000000:3.0:1782240063.188699:0:14058:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1782240063.188703:0:14058:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9bb5d204d000 10000000:01000000:3.0:1782240063.188705:0:14058:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1782240063.188707:0:14058:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff9bb5d204d000 from 1 10000000:01000000:3.0:1782240063.188710:0:14058:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1782240063.188734:0:14058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e27c00/0x8c5345f1c1ec5cbd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240063.188780:0:14058:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e27c00/0x8c5345f1c1ec5cbd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240063.188789:0:14058:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e27c00/0x8c5345f1c1ec5cbd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782240063.188980:0:14058:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f4895880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14058:1868813758980608:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1782240063.189014:0:14058:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782240063.189036:0:14058:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5d1cab9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782240063.189106:0:14070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758980608 00000100:00100000:2.0:1782240063.189111:0:14070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758980608 00000100:00100000:2.0:1782240063.189155:0:14070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1782240063.189172:0:14070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7b04850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+6:14058:x1868813758980608:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1782240063.189182:0:14070:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782240063.189195:0:14070:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb5ee29e400/0x8c5345f1c1ec5cc4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c5345f1c1ec5cbd expref: -99 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240063.189215:0:14070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb5ee29e400/0x8c5345f1c1ec5cc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c5345f1c1ec5cbd expref: 7 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240063.189224:0:14070:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb5ee29e400/0x8c5345f1c1ec5cc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c5345f1c1ec5cbd expref: 7 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240063.189233:0:14070:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5ee29e400, rc 0) 00000100:00100000:2.0:1782240063.189263:0:14070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7b04850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+7:14058:x1868813758980608:12345-0@lo:101:mount.lustre.0 Request processed in 92us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1782240063.189280:0:14070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1782240063.189537:0:14058:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f4895880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14058:1868813758980608:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1782240063.189550:0:14058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e27c00/0x8c5345f1c1ec5cbd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec5cc4 expref: -99 pid: 14058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240063.189558:0:14058:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e27c00/0x8c5345f1c1ec5cbd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c5345f1c1ec5cc4 expref: -99 pid: 14058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782240063.189696:0:14058:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1782240063.189701:0:14058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e27c00/0x8c5345f1c1ec5cbd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec5cc4 expref: -99 pid: 14058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240063.189708:0:14058:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e27c00/0x8c5345f1c1ec5cbd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec5cc4 expref: -99 pid: 14058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782240063.189714:0:14058:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1782240063.189718:0:14058:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1782240063.189723:0:14058:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9bb5d204d000 10000000:01000000:3.0:1782240063.189726:0:14058:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1782240063.189736:0:14058:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1782240063.189738:0:14058:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1782240063.189786:0:14058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e27a00/0x8c5345f1c1ec5ccb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240063.189888:0:14058:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e27a00/0x8c5345f1c1ec5ccb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240063.189899:0:14058:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e27a00/0x8c5345f1c1ec5ccb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782240063.189914:0:14058:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f4895880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14058:1868813758980736:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1782240063.189943:0:14058:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782240063.189970:0:14058:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5d1cab9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782240063.190021:0:14068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758980736 00000100:00100000:2.0:1782240063.190031:0:14068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758980736 00000100:00100000:2.0:1782240063.190067:0:14068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1782240063.190074:0:14068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+7:14058:x1868813758980736:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1782240063.190082:0:14068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782240063.190091:0:14068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb5ee29ea00/0x8c5345f1c1ec5cd2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c5345f1c1ec5ccb expref: -99 pid: 14068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240063.190107:0:14068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb5ee29ea00/0x8c5345f1c1ec5cd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c5345f1c1ec5ccb expref: 8 pid: 14068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240063.190115:0:14068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb5ee29ea00/0x8c5345f1c1ec5cd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c5345f1c1ec5ccb expref: 8 pid: 14068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240063.190122:0:14068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5ee29ea00, rc 0) 00000100:00100000:2.0:1782240063.190151:0:14068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+8:14058:x1868813758980736:12345-0@lo:101:mount.lustre.0 Request processed in 77us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1782240063.190169:0:14068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1782240063.190958:0:14058:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f4895880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14058:1868813758980736:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1782240063.190975:0:14058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e27a00/0x8c5345f1c1ec5ccb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec5cd2 expref: -99 pid: 14058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240063.190984:0:14058:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e27a00/0x8c5345f1c1ec5ccb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c5345f1c1ec5cd2 expref: -99 pid: 14058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782240063.191038:0:14058:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f4895880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14058:1868813758980864:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782240063.191071:0:14058:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782240063.191092:0:14058:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5d1cab9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782240063.191140:0:14071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758980864 00000100:00100000:0.0:1782240063.191145:0:14071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758980864 00000100:00100000:0.0:1782240063.191245:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1782240063.191254:0:14071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+8:14058:x1868813758980864:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782240063.193396:0:14058:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f4895880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14058:1868813758980864:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782240063.193446:0:14058:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f4895880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14058:1868813758980992:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1782240063.193513:0:14071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+9:14058:x1868813758980864:12345-0@lo:501:mount.lustre.0 Request processed in 2251us (2431us total) trans 0 rc 0/0 00000100:00100000:0.0:1782240063.193530:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1782240063.195715:0:14058:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782240063.195926:0:14070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758980992 00000100:00100000:2.0:1782240063.195935:0:14070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758980992 00000100:00100000:2.0:1782240063.196075:0:14070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1782240063.196085:0:14070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+9:14058:x1868813758980992:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1782240063.196615:0:14070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+9:14058:x1868813758980992:12345-0@lo:503:mount.lustre.0 Request processed in 530us (903us total) trans 0 rc 0/0 00000100:00100000:2.0:1782240063.196622:0:14070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1782240063.198478:0:14058:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5d1cab9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782240063.198530:0:14058:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f4895880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14058:1868813758980992:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1782240063.200074:0:14094:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f4895880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14094:1868813758981120:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782240063.200151:0:14094:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782240063.200199:0:14094:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5d1cab0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782240063.200465:0:14071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758981120 00000100:00100000:0.0:1782240063.200471:0:14071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758981120 00000100:00100000:1.0:1782240063.200650:0:14068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1782240063.200661:0:14068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+9:14094:x1868813758981120:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782240063.201066:0:14068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+9:14094:x1868813758981120:12345-0@lo:502:llog_process_th.0 Request processed in 406us (914us total) trans 0 rc 0/0 00000100:00100000:1.0:1782240063.201074:0:14068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1782240063.201453:0:14094:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f4895880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14094:1868813758981120:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782240063.201483:0:14094:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782240063.201494:0:14094:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782240063.201496:0:14094:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1782240063.201500:0:14094:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1782240063.201503:0:14094:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1782240063.201529:0:14094:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9bb5f78a4d40) 00000020:00000080:3.0:1782240063.201549:0:14094:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1782240063.201555:0:14094:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1782240063.201687:0:14094:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:3.0:1782240063.201694:0:14094:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8c5345f1c1ec5ce0 00000020:00000080:3.0:1782240063.202987:0:14094:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1782240063.202995:0:14094:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782240063.203002:0:14094:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782240063.203003:0:14094:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1782240063.203007:0:14094:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782240063.203013:0:14094:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782240063.203014:0:14094:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1782240063.203017:0:14094:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1782240063.203029:0:14094:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9bb5f78a19c0) 00000020:00000080:3.0:1782240063.203043:0:14094:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1782240063.203047:0:14094:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1782240063.203049:0:14094:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1782240063.203051:0:14094:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1782240063.203057:0:14094:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1782240063.203130:0:14094:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bb5d204d000 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1782240063.203143:0:14094:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9bb5f78a3380) 00000020:00000080:3.0:1782240063.203152:0:14094:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1782240063.204229:0:14094:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1782240063.204239:0:14094:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8c5345f1c1ec5cf5 00000020:00000080:2.0:1782240063.204483:0:14094:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1782240063.204489:0:14094:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1782240063.204494:0:14094:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x8c5345f1c1ec5cfc 00080000:01000000:2.0:1782240063.204633:0:14094:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:2.0:1782240063.204639:0:14094:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8c5345f1c1ec5d03 00010000:00010000:2.0:1782240063.361315:0:14094:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1782240063.364841:0:14094:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967527 00000001:00080000:3.0:1782240063.365512:0:14094:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1782240063.366064:0:14094:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9bb5f78a0000) 00000020:00000080:3.0:1782240063.366082:0:14094:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1782240063.366158:0:14094:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:3.0:1782240063.366164:0:14094:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8c5345f1c1ec5d11 00000020:00000080:3.0:1782240063.368572:0:14094:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1782240063.388404:0:14094:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x8c5345f1c1ec5d18 00000020:00000080:3.0:1782240063.389126:0:14094:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1782240063.389136:0:14094:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782240063.389143:0:14094:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782240063.389145:0:14094:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1782240063.389149:0:14094:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1782240063.389151:0:14094:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:3.0:1782240063.389153:0:14094:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1782240063.389154:0:14094:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1782240063.389156:0:14094:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1782240063.389158:0:14094:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782240063.389160:0:14094:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:3.0:1782240063.389162:0:14094:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782240063.389167:0:14094:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782240063.389168:0:14094:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1782240063.389172:0:14094:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1782240063.389208:0:14094:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1782240063.389222:0:14094:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782240063.389225:0:14094:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782240063.389227:0:14094:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1782240063.389229:0:14094:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1782240063.389232:0:14094:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1782240063.389236:0:14094:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782240063.389243:0:14094:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1782240063.389247:0:14094:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1782240063.389253:0:14094:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.132@tcp to nid 0x20000c0a8cb84 (192.168.203.132@tcp) 00000020:01000000:3.0:1782240063.389278:0:14094:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1782240063.389281:0:14094:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1782240063.389305:0:14094:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9bb5ded019c0) 00000020:00000080:3.0:1782240063.389319:0:14094:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1782240063.389324:0:14094:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1782240063.389387:0:14094:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1782240063.389393:0:14094:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:3.0:1782240063.389399:0:14094:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8c5345f1c1ec5d26 00010000:00080000:3.0:1782240063.389429:0:14094:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bb601914000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.132@tcp at head 00010000:00010000:3.0:1782240063.390062:0:14094:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:3.0:1782240063.390514:0:14094:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1782240063.391163:0:14094:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1782240063.392546:0:14094:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782240063.392606:0:14094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1782240063.392678:0:14094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1782240063.396315:0:14098:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1782240063.396322:0:14098:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1782240063.397057:0:14094:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1782240063.397074:0:14094:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1782240063.397113:0:14094:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1782240063.397143:0:14094:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8c5345f1c1ec5d2d 00000100:00080000:1.0:1782240063.397154:0:14094:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1782240063.397160:0:14094:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9bb601914000 using connection 192.168.203.132@tcp/0@lo 00000100:00100000:1.0:1782240063.397196:0:14094:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bb5fc2a9500 x1868813758981248/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1782240063.397263:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fc2a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1868813758981248:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1782240063.397335:0:3303:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1868813758981248 offset 0 length 520: 4 00000100:00080000:1.0:1782240063.397394:0:14094:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1782240063.397452:0:14094:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782240063.397456:0:14094:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782240063.397458:0:14094:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1782240063.397461:0:14094:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1782240063.397464:0:14094:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #15 00000020:01000000:1.0:1782240063.397465:0:14094:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1782240063.397467:0:14094:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1782240063.397468:0:14094:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1782240063.397471:0:14094:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782240063.397472:0:14094:0:(obd_config.c:1561:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:1.0:1782240063.397475:0:14094:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1782240063.397479:0:14094:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1782240063.397482:0:14094:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782240063.397483:0:14094:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1782240063.397486:0:14094:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1782240063.397490:0:14094:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.132@tcp to nid 0x20000c0a8cb84 (192.168.203.132@tcp) 00000020:01000000:1.0:1782240063.397509:0:14094:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1782240063.397512:0:14094:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1782240063.397523:0:14094:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9bb60182b380) 00000020:00000080:1.0:1782240063.397535:0:14094:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1782240063.397552:0:14094:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1782240063.397607:0:14094:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1782240063.397613:0:14094:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:1.0:1782240063.397623:0:14094:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8c5345f1c1ec5d3b 00010000:00080000:1.0:1782240063.397650:0:14094:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bb5fbba2800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.132@tcp at head 00010000:00010000:1.0:1782240063.398157:0:14094:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:1.0:1782240063.398352:0:14094:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1782240063.398378:0:14094:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1782240063.399485:0:14094:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1782240063.401603:0:14094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1782240063.401706:0:14094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:3.0:1782240063.402474:0:14100:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1782240063.402480:0:14100:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1782240063.403587:0:14094:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1782240063.403599:0:14094:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1782240063.403633:0:14094:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1782240063.403652:0:14094:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8c5345f1c1ec5d42 00000100:00080000:0.0:1782240063.403662:0:14094:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1782240063.403667:0:14094:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9bb5fbba2800 using connection 192.168.203.132@tcp/0@lo 00000100:00100000:0.0:1782240063.403702:0:14094:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bb5f77a5180 x1868813758981376/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1782240063.403738:0:14094:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1782240063.403817:0:14094:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782240063.403821:0:14094:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782240063.403823:0:14094:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1782240063.403825:0:14094:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782240063.403829:0:14094:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782240063.403830:0:14094:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:0.0:1782240063.403833:0:14094:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1782240063.403835:0:14094:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1782240063.403837:0:14094:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782240063.403839:0:14094:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782240063.403840:0:14094:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:0.0:1782240063.403842:0:14094:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782240063.403844:0:14094:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782240063.403846:0:14094:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1782240063.403849:0:14094:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1782240063.403878:0:14094:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f77a5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14094:1868813758981504:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782240063.403959:0:14094:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782240063.403994:0:14094:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5cfcecb40 going to sleep for 11 seconds 00000100:00100000:1.0:1782240063.404080:0:14068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758981504 00000100:00100000:1.0:1782240063.404087:0:14068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758981504 00000100:00100000:1.0:1782240063.404126:0:14068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1782240063.404135:0:14068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+9:14094:x1868813758981504:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782240063.404387:0:14068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+9:14094:x1868813758981504:12345-0@lo:502:llog_process_th.0 Request processed in 252us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1782240063.404395:0:14068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1782240063.404872:0:14094:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f77a5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14094:1868813758981504:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1782240063.404902:0:14094:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782240063.404908:0:14094:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782240063.404910:0:14094:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1782240063.404913:0:14094:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000100:00100000:3.0:1782240063.405321:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f77a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1868813758981376:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1782240063.405357:0:3303:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1868813758981376 offset 0 length 520: 4 00000020:01000000:1.0:1782240063.411661:0:14058:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:1.0:1782240063.411695:0:14058:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1782240063.411720:0:14058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e27a00/0x8c5345f1c1ec5ccb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec5cd2 expref: -99 pid: 14058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240063.411763:0:14058:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e27a00/0x8c5345f1c1ec5ccb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec5cd2 expref: -99 pid: 14058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782240063.411774:0:14058:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9bb5d204d000 from 1 10000000:01000000:1.0:1782240063.411776:0:14058:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1782240063.411821:0:14058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e39c00/0x8c5345f1c1ec5d49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240063.411830:0:14058:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e39c00/0x8c5345f1c1ec5d49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240063.411858:0:14058:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e39c00/0x8c5345f1c1ec5d49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782240063.411884:0:14058:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fc2aaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14058:1868813758981632:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1782240063.411953:0:14058:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782240063.412002:0:14058:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5d0dde180 going to sleep for 11 seconds 00000100:00100000:3.0:1782240063.412150:0:14070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758981632 00000100:00100000:3.0:1782240063.412157:0:14070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758981632 00000100:00100000:3.0:1782240063.412202:0:14070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1782240063.412218:0:14070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+9:14058:x1868813758981632:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1782240063.412231:0:14070:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782240063.412245:0:14070:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb5f7e26c00/0x8c5345f1c1ec5d50 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c5345f1c1ec5d49 expref: -99 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240063.412268:0:14070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb5f7e26c00/0x8c5345f1c1ec5d50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c5345f1c1ec5d49 expref: 10 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240063.412278:0:14070:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb5f7e26c00/0x8c5345f1c1ec5d50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c5345f1c1ec5d49 expref: 10 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240063.412287:0:14070:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5f7e26c00, rc 0) 00000100:00100000:3.0:1782240063.412333:0:14070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+10:14058:x1868813758981632:12345-0@lo:101:mount.lustre.0 Request processed in 116us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1782240063.412340:0:14070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1782240063.412705:0:14058:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fc2aaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14058:1868813758981632:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782240063.412717:0:14058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e39c00/0x8c5345f1c1ec5d49 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec5d50 expref: -99 pid: 14058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240063.412735:0:14058:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e39c00/0x8c5345f1c1ec5d49 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c5345f1c1ec5d50 expref: -99 pid: 14058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782240063.413981:0:14058:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fc2aaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14058:1868813758981760:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1782240063.414035:0:14058:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782240063.414105:0:14058:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5d0dde180 going to sleep for 11 seconds 00000100:00100000:0.0:1782240063.414694:0:14071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758981760 00000100:00100000:0.0:1782240063.414701:0:14071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758981760 00000100:00100000:0.0:1782240063.415712:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1782240063.415736:0:14071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+10:14058:x1868813758981760:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1782240063.416152:0:14071:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1782240063.416160:0:14071:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1782240063.416260:0:14071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+10:14058:x1868813758981760:12345-0@lo:256:mount.lustre.0 Request processed in 535us (2223us total) trans 0 rc 0/0 00000100:00100000:0.0:1782240063.416268:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1782240063.416405:0:14058:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fc2aaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14058:1868813758981760:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1782240063.417067:0:14058:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1782240063.417086:0:14058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e39c00/0x8c5345f1c1ec5d49 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec5d50 expref: -99 pid: 14058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240063.417098:0:14058:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e39c00/0x8c5345f1c1ec5d49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec5d50 expref: -99 pid: 14058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782240063.417107:0:14058:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9bb5d204d000 from 1 10000000:01000000:1.0:1782240063.417109:0:14058:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1782240063.417148:0:14058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e39000/0x8c5345f1c1ec5d57 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240063.417156:0:14058:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e39000/0x8c5345f1c1ec5d57 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240063.417165:0:14058:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e39000/0x8c5345f1c1ec5d57 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782240063.417184:0:14058:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fc2aaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14058:1868813758981888:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1782240063.417223:0:14058:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782240063.417652:0:14058:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5d0dde180 going to sleep for 11 seconds 00000100:00100000:2.0:1782240063.418188:0:14068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758981888 00000100:00100000:2.0:1782240063.418196:0:14068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758981888 00000100:00100000:2.0:1782240063.418322:0:14068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1782240063.418331:0:14068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+10:14058:x1868813758981888:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1782240063.418344:0:14068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782240063.418358:0:14068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb5ee29fc00/0x8c5345f1c1ec5d5e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c5345f1c1ec5d57 expref: -99 pid: 14068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240063.418379:0:14068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb5ee29fc00/0x8c5345f1c1ec5d5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c5345f1c1ec5d57 expref: 11 pid: 14068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240063.418388:0:14068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb5ee29fc00/0x8c5345f1c1ec5d5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c5345f1c1ec5d57 expref: 11 pid: 14068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240063.418396:0:14068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5ee29fc00, rc 0) 00000100:00100000:2.0:1782240063.418445:0:14068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+11:14058:x1868813758981888:12345-0@lo:101:mount.lustre.0 Request processed in 115us (1221us total) trans 0 rc 0/0 00000100:00100000:2.0:1782240063.418450:0:14068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1782240063.418517:0:14058:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fc2aaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14058:1868813758981888:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782240063.418532:0:14058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e39000/0x8c5345f1c1ec5d57 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec5d5e expref: -99 pid: 14058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240063.418555:0:14058:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e39000/0x8c5345f1c1ec5d57 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c5345f1c1ec5d5e expref: -99 pid: 14058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782240063.418609:0:14058:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fc2aaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14058:1868813758982016:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782240063.418637:0:14058:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782240063.425411:0:14058:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5d0dde180 going to sleep for 11 seconds 00000100:00100000:3.0:1782240063.427636:0:14070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758982016 00000100:00100000:3.0:1782240063.427650:0:14070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758982016 00000100:00100000:3.0:1782240063.427703:0:14070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1782240063.427714:0:14070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+11:14058:x1868813758982016:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782240063.428962:0:14070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+11:14058:x1868813758982016:12345-0@lo:501:mount.lustre.0 Request processed in 1246us (10319us total) trans 0 rc 0/0 00000100:00100000:3.0:1782240063.428973:0:14070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1782240063.431461:0:14058:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fc2aaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14058:1868813758982016:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782240063.431525:0:14058:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fc2aaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14058:1868813758982144:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1782240063.431891:0:14058:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782240063.432010:0:14058:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5d0dde180 going to sleep for 11 seconds 00000100:00100000:0.0:1782240063.432134:0:14071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758982144 00000100:00100000:0.0:1782240063.432142:0:14071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758982144 00000100:00100000:3.0:1782240063.432307:0:14070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1782240063.432319:0:14070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+11:14058:x1868813758982144:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1782240063.432560:0:14070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+11:14058:x1868813758982144:12345-0@lo:503:mount.lustre.0 Request processed in 243us (669us total) trans 0 rc 0/0 00000100:00100000:3.0:1782240063.432569:0:14070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1782240063.433053:0:14058:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fc2aaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14058:1868813758982144:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1782240063.433488:0:14102:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fc2aaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14102:1868813758982272:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782240063.433530:0:14102:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782240063.434077:0:14102:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5d0dded80 going to sleep for 11 seconds 00000100:00100000:2.0:1782240063.434234:0:14068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758982272 00000100:00100000:2.0:1782240063.434240:0:14068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758982272 00000100:00100000:2.0:1782240063.434272:0:14068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1782240063.434279:0:14068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+11:14102:x1868813758982272:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782240063.434508:0:14068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+11:14102:x1868813758982272:12345-0@lo:502:llog_process_th.0 Request processed in 228us (976us total) trans 0 rc 0/0 00000100:00100000:2.0:1782240063.434516:0:14068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1782240063.434675:0:14102:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fc2aaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14102:1868813758982272:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1782240063.434701:0:14102:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782240063.434710:0:14102:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782240063.434712:0:14102:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1782240063.434719:0:14102:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bb5d204d000 00000020:00000080:1.0:1782240063.434721:0:14102:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1782240063.434739:0:14102:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782240063.434762:0:14102:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782240063.434764:0:14102:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1782240063.434767:0:14102:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782240063.434770:0:14102:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782240063.434772:0:14102:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1782240063.434775:0:14102:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bb5d204d000 00000020:00000080:1.0:1782240063.434777:0:14102:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1782240063.434827:0:14102:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782240063.434830:0:14102:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782240063.434832:0:14102:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1782240063.434834:0:14102:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782240063.434837:0:14102:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782240063.434838:0:14102:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1782240063.434842:0:14102:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9bb5d204d000 00000020:00000080:1.0:1782240063.434844:0:14102:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1782240063.434879:0:14102:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fc2aaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14102:1868813758982400:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782240063.434914:0:14102:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782240063.434930:0:14102:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5d0dded80 going to sleep for 11 seconds 00000100:00100000:2.0:1782240063.435089:0:14068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758982400 00000100:00100000:2.0:1782240063.435099:0:14068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758982400 00000100:00100000:2.0:1782240063.435192:0:14068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1782240063.435197:0:14068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f39b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+11:14102:x1868813758982400:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782240063.435342:0:14068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f39b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+11:14102:x1868813758982400:12345-0@lo:502:llog_process_th.0 Request processed in 143us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1782240063.435349:0:14068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1782240063.440053:0:14102:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fc2aaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14102:1868813758982400:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1782240063.440178:0:14102:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782240063.440187:0:14102:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782240063.440189:0:14102:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1782240063.440193:0:14102:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1782240063.441639:0:14058:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1782240063.441664:0:14058:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1782240063.441690:0:14058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e39000/0x8c5345f1c1ec5d57 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec5d5e expref: -99 pid: 14058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240063.441703:0:14058:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e39000/0x8c5345f1c1ec5d57 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec5d5e expref: -99 pid: 14058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782240063.442097:0:14058:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1782240063.442101:0:14058:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9bb5d204d000 10000000:01000000:3.0:1782240063.442835:0:14058:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9bb5d204d000 10000000:01000000:3.0:1782240063.442840:0:14058:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1782240063.442847:0:14058:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9bb5d204d000 from 1 10000000:01000000:3.0:1782240063.442850:0:14058:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1782240063.442888:0:14058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e27200/0x8c5345f1c1ec5d65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240063.442899:0:14058:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e27200/0x8c5345f1c1ec5d65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240063.442910:0:14058:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e27200/0x8c5345f1c1ec5d65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782240063.442932:0:14058:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f4895880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14058:1868813758982528:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1782240063.442992:0:14058:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782240063.443034:0:14058:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5e8d3f840 going to sleep for 11 seconds 00000100:00100000:2.0:1782240063.443174:0:14068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758982528 00000100:00100000:2.0:1782240063.443181:0:14068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758982528 00000100:00100000:2.0:1782240063.443230:0:14068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1782240063.443239:0:14068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f39b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+11:14058:x1868813758982528:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1782240063.443252:0:14068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782240063.443265:0:14068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb5ee29ee00/0x8c5345f1c1ec5d6c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c5345f1c1ec5d65 expref: -99 pid: 14068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240063.443298:0:14068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb5ee29ee00/0x8c5345f1c1ec5d6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c5345f1c1ec5d65 expref: 12 pid: 14068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240063.443310:0:14068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb5ee29ee00/0x8c5345f1c1ec5d6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c5345f1c1ec5d65 expref: 12 pid: 14068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240063.443320:0:14068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5ee29ee00, rc 0) 00000100:00100000:2.0:1782240063.443358:0:14068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f39b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+12:14058:x1868813758982528:12345-0@lo:101:mount.lustre.0 Request processed in 120us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1782240063.443365:0:14068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1782240063.443455:0:14058:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f4895880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14058:1868813758982528:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1782240063.443469:0:14058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e27200/0x8c5345f1c1ec5d65 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec5d6c expref: -99 pid: 14058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240063.443490:0:14058:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e27200/0x8c5345f1c1ec5d65 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c5345f1c1ec5d6c expref: -99 pid: 14058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782240063.443553:0:14058:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f4895880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14058:1868813758982656:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782240063.443579:0:14058:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782240063.443605:0:14058:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5e8d3f840 going to sleep for 11 seconds 00000100:00100000:2.0:1782240063.444853:0:14070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758982656 00000100:00100000:2.0:1782240063.444862:0:14070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758982656 00000100:00100000:2.0:1782240063.444903:0:14068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1782240063.444911:0:14068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f39b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+12:14058:x1868813758982656:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1782240063.445169:0:14068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f39b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+12:14058:x1868813758982656:12345-0@lo:501:mount.lustre.0 Request processed in 258us (1587us total) trans 0 rc 0/0 00000100:00100000:2.0:1782240063.445176:0:14068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1782240063.445895:0:14058:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f4895880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14058:1868813758982656:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782240063.445938:0:14058:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f4895880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14058:1868813758982784:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1782240063.445986:0:14058:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782240063.446013:0:14058:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5e8d3f840 going to sleep for 11 seconds 00000100:00100000:2.0:1782240063.448216:0:14071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758982784 00000100:00100000:2.0:1782240063.448226:0:14071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758982784 00000100:00100000:2.0:1782240063.448283:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1782240063.448301:0:14071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f39bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+12:14058:x1868813758982784:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1782240063.448516:0:14071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f39bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+12:14058:x1868813758982784:12345-0@lo:503:mount.lustre.0 Request processed in 224us (2529us total) trans 0 rc 0/0 00000100:00100000:2.0:1782240063.448524:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1782240063.448686:0:14058:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f4895880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14058:1868813758982784:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1782240063.458782:0:14104:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f4895f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14104:1868813758982912:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782240063.460260:0:14104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782240063.460318:0:14104:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5e8d3fb40 going to sleep for 11 seconds 00000100:00100000:2.0:1782240063.460390:0:14070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758982912 00000100:00100000:2.0:1782240063.460398:0:14070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758982912 00000100:00100000:2.0:1782240063.460439:0:14070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1782240063.460447:0:14070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f39b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+12:14104:x1868813758982912:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782240063.460913:0:14070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f39b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+12:14104:x1868813758982912:12345-0@lo:502:llog_process_th.0 Request processed in 465us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1782240063.460921:0:14070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1782240063.464042:0:14104:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f4895f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14104:1868813758982912:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1782240063.464277:0:14104:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1782240063.464311:0:14104:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9bb5ef2199c0) 00000020:00000080:2.0:1782240063.464335:0:14104:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:2.0:1782240063.464497:0:14104:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bb5d204d000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1782240063.464501:0:14104:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bb5d204d000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1782240063.464503:0:14104:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9bb5d204d000 4 00010000:00080000:2.0:1782240063.464530:0:14104:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bb5f4998000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.132@tcp at head 00010000:00010000:2.0:1782240063.467395:0:14104:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:2.0:1782240063.467507:0:14104:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1782240063.467542:0:14104:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1782240063.467556:0:14104:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x8c5345f1c1ec5d7a 00000100:00080000:2.0:1782240063.467568:0:14104:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1782240063.467574:0:14104:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9bb5f4998000 using connection 192.168.203.132@tcp/0@lo 00000100:00100000:2.0:1782240063.467605:0:14104:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bb5fbe0bb80 x1868813758983040/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1782240063.467648:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fbe0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1868813758983040:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1782240063.467712:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1782240063.468978:0:14104:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1782240063.469362:0:14076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758983040 00000100:00100000:3.0:1782240063.469371:0:14076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758983040 00000100:00100000:3.0:1782240063.469408:0:14076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782240063.469415:0:14076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fbe08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3303:x1868813758983040:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1782240063.469489:0:14076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fbe08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3303:x1868813758983040:12345-0@lo:38:llog_process_th.0 Request processed in 72us (1776us total) trans 0 rc -11/-11 00000100:00100000:3.0:1782240063.469495:0:14076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782240063.469501:0:3303:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1782240063.469508:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9bb5f4998000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1782240063.469512:0:3303:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1782240063.469516:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fbe0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1868813758983040:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1782240063.473741:0:14104:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fbe0bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14104:1868813758983168:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782240063.477968:0:14104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782240063.478000:0:14071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758983168 00000100:00100000:2.0:1782240063.478007:0:14071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758983168 00000100:00100000:2.0:1782240063.478046:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1782240063.478054:0:14071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f39b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+12:14104:x1868813758983168:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782240063.478275:0:14071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f39b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+12:14104:x1868813758983168:12345-0@lo:502:llog_process_th.0 Request processed in 221us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1782240063.478282:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1782240063.478348:0:14104:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5e8e80180 going to sleep for 11 seconds 00000100:00100000:2.0:1782240063.478369:0:14104:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fbe0bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14104:1868813758983168:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1782240063.478407:0:14104:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1782240063.478645:0:14058:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1782240063.478663:0:14058:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1782240063.478682:0:14058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e27200/0x8c5345f1c1ec5d65 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec5d6c expref: -99 pid: 14058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240063.478693:0:14058:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e27200/0x8c5345f1c1ec5d65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec5d6c expref: -99 pid: 14058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1782240063.478737:0:14058:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1782240063.478739:0:14058:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1782240063.478740:0:14058:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782240063.478742:0:14058:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782240063.478743:0:14058:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782240063.478745:0:14058:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782240063.478777:0:14058:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1782240063.478785:0:14058:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1782240063.478787:0:14058:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782240063.478788:0:14058:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1782240063.478792:0:14058:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1782240063.478794:0:14058:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1782240063.478795:0:14058:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1782240063.478796:0:14058:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782240063.478797:0:14058:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782240063.478798:0:14058:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782240063.478799:0:14058:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782240063.478800:0:14058:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1782240063.478801:0:14058:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1782240063.478802:0:14058:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782240063.478803:0:14058:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1782240063.478822:0:14058:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1782240063.478837:0:14058:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f77a5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14058:1868813758983296:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1782240063.478871:0:14058:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782240063.478899:0:14058:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c87f86c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782240063.478913:0:14068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758983296 00000100:00100000:1.0:1782240063.478919:0:14068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758983296 00000100:00100000:1.0:1782240063.478945:0:14068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1782240063.478952:0:14068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f39bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+12:14058:x1868813758983296:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1782240063.478970:0:14068:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1782240063.478982:0:14068:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1782240063.563965:0:14068:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1782240063.563996:0:14068:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1782240063.566652:0:14092:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1782240063.566662:0:14092:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1782240063.566685:0:14092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bb5ee29e800/0x8c5345f1c1ec5d81 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240063.566704:0:14092:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bb5f7e26c00/0x8c5345f1c1ec5d50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c5345f1c1ec5d49 expref: 12 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240063.566713:0:14092:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bb5ee29e800/0x8c5345f1c1ec5d81 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240063.566776:0:14092:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bb5f7e26c00/0x8c5345f1c1ec5d50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8c5345f1c1ec5d49 expref: 12 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240063.566792:0:14092:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bb5f7e26c00/0x8c5345f1c1ec5d50 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8c5345f1c1ec5d49 expref: 12 pid: 14070 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782240063.566807:0:14092:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fbe0bb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14092:1868813758983424:0@lo:104: 00000100:00100000:2.0:1782240063.566868:0:14092:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782240063.566925:0:14092:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5e8e803c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782240063.568867:0:14059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758983424 00000100:00100000:0.0:1782240063.568879:0:14059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758983424 00000100:00100000:0.0:1782240063.568924:0:14059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782240063.568933:0:14059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fbe08380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+3:14092:x1868813758983424:12345-0@lo:104: 00010000:00010000:0.0:1782240063.568949:0:14059:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e39c00/0x8c5345f1c1ec5d49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c5345f1c1ec5d50 expref: -99 pid: 14058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240063.569027:0:14059:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782240063.569033:0:14059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fbe08380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+3:14092:x1868813758983424:12345-0@lo:104: Request processed in 102us (2165us total) trans 0 rc 0/0 00000100:00100000:0.0:1782240063.569039:0:14059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782240063.569082:0:14092:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fbe0bb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14092:1868813758983424:0@lo:104: 00010000:00010000:0.0:1782240063.569107:0:14092:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bb5ee29e800/0x8c5345f1c1ec5d81 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240063.569355:0:14065:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782240063.569361:0:14065:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e39c00/0x8c5345f1c1ec5d49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c5345f1c1ec5d50 expref: -99 pid: 14058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240063.569369:0:14065:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f7e39c00 already unused, calling callback (ffffffffc1d0cc20) 10000000:00010000:1.0:1782240063.569372:0:14065:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e39c00/0x8c5345f1c1ec5d49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8c5345f1c1ec5d50 expref: -99 pid: 14058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240063.569380:0:14065:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e39c00/0x8c5345f1c1ec5d49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8c5345f1c1ec5d50 expref: -99 pid: 14058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782240063.569386:0:14065:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e39c00/0x8c5345f1c1ec5d49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8c5345f1c1ec5d50 expref: -99 pid: 14058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782240063.569392:0:14065:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1782240063.569431:0:14065:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e39c00/0x8c5345f1c1ec5d49 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c5345f1c1ec5d50 expref: -99 pid: 14058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240063.569447:0:14065:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782240063.569469:0:14065:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e39c00/0x8c5345f1c1ec5d49 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c5345f1c1ec5d50 expref: -99 pid: 14058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240063.569475:0:14065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e39c00/0x8c5345f1c1ec5d49 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c5345f1c1ec5d50 expref: -99 pid: 14058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240063.569490:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782240063.569492:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782240063.569494:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782240063.570799:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fc2aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:3305:1868813758983552:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782240063.570857:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782240063.570933:0:14061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758983552 00000100:00100000:3.0:1782240063.570947:0:14061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758983552 00010000:00010000:3.0:1782240063.570973:0:14061:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bb5f7e26c00/0x8c5345f1c1ec5d50 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c5345f1c1ec5d49 expref: 13 pid: 14070 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782240063.571000:0:14061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782240063.571007:0:14061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f4895f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+13:3305:x1868813758983552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782240063.571020:0:14061:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782240063.571025:0:14061:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bb5f7e26c00/0x8c5345f1c1ec5d50 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c5345f1c1ec5d49 expref: 13 pid: 14070 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240063.571035:0:14061:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bb5f7e26c00/0x8c5345f1c1ec5d50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8c5345f1c1ec5d49 expref: 13 pid: 14070 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240063.571049:0:14061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb5f7e26c00/0x8c5345f1c1ec5d50 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8c5345f1c1ec5d49 expref: 13 pid: 14070 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240063.571064:0:14061:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bb5ee29e800/0x8c5345f1c1ec5d81 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240063.571072:0:14061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb5ee29e800/0x8c5345f1c1ec5d81 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1782240063.571087:0:14061:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004426508s 00010000:00010000:3.0:1782240063.571092:0:14061:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bb5ee29e800/0x8c5345f1c1ec5d81 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240063.571098:0:14061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bb5ee29e800/0x8c5345f1c1ec5d81 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240063.571104:0:14061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bb5ee29e800/0x8c5345f1c1ec5d81 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240063.571119:0:14061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bb5ee29e800/0x8c5345f1c1ec5d81 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240063.571124:0:14061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5ee29e800 already unused, calling callback (ffffffffc1728ce0) 00010000:00010000:3.0:1782240063.571128:0:14061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bb5ee29e800/0x8c5345f1c1ec5d81 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240063.571135:0:14061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bb5ee29e800/0x8c5345f1c1ec5d81 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240063.571149:0:14061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bb5ee29e800/0x8c5345f1c1ec5d81 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240063.571158:0:14061:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782240063.571191:0:14061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f4895f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+12:3305:x1868813758983552:12345-0@lo:103:ldlm_bl.0 Request processed in 184us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1782240063.571198:0:14061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782240063.571231:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fc2aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:3305:1868813758983552:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782240063.571250:0:14092:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bb5ee29e800/0x8c5345f1c1ec5d81 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240063.571256:0:14092:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bb5ee29e800/0x8c5345f1c1ec5d81 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240063.571262:0:14092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb5ee29e800/0x8c5345f1c1ec5d81 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782240063.576906:0:14068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f39bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+11:14058:x1868813758983296:12345-0@lo:253:mount.lustre.0 Request processed in 97945us (98026us total) trans 0 rc 0/0 00000100:00100000:0.0:1782240063.576920:0:14068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1782240063.576995:0:14058:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f77a5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14058:1868813758983296:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1782240063.577010:0:14058:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1782240063.577014:0:14058:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1782240063.577016:0:14058:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1782240063.577017:0:14058:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782240063.577018:0:14058:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1782240063.577019:0:14058:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782240063.577021:0:14058:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782240063.577022:0:14058:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1782240063.577024:0:14058:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1782240063.577025:0:14058:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782240063.577027:0:14058:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1782240063.577041:0:14058:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1782240063.581056:0:14058:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1782240063.581229:0:14058:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1782240063.581514:0:14058:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1782240063.581689:0:14058:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1782240063.581989:0:14058:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1782240063.582149:0:14058:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1782240063.583340:0:14058:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1782240063.583847:0:14058:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1782240063.584139:0:14058:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1782240063.584381:0:14058:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1782240063.584730:0:14058:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1782240063.584986:0:14058:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:3.0:1782240063.610460:0:14058:0:(update_trans.c:1487:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:3.0:1782240063.610984:0:14058:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:3.0:1782240063.611265:0:14116:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:3.0:1782240063.611342:0:14116:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782240063.613387:0:14116:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1782240063.613465:0:14116:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1782240063.613469:0:14116:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:1.0:1782240063.615979:0:14058:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1782240063.616121:0:14058:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1782240063.616588:0:14058:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1782240063.616595:0:14058:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1782240063.616730:0:14058:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:0.0:1782240063.617675:0:14115:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:0.0:1782240063.617680:0:14115:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:00080000:1.0:1782240063.618321:0:14058:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1782240063.618979:0:14058:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1782240063.619016:0:14058:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:1.0:1782240063.620438:0:14058:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:3.0:1782240063.633844:0:14058:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1782240063.703552:0:14058:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1782240063.703670:0:14058:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffc134c19df988 00100000:10000000:1.0:1782240063.703678:0:14058:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1782240063.705121:0:14058:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1782240063.705137:0:14058:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.132@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1782240063.705152:0:14058:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1782240063.705168:0:14058:0:(super25.c:187:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:1.0:1782240063.979930:0:14064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1782240064.545060:0:14110:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:1.0:1782240064.798834:0:14073:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1782240064.798842:0:14073:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9bb5d204d000 from 6 10000000:01000000:1.0:1782240064.798848:0:14073:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1782240064.798906:0:14073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e38e00/0x8c5345f1c1ec5d88 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240064.798918:0:14073:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e38e00/0x8c5345f1c1ec5d88 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240064.798945:0:14073:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e38e00/0x8c5345f1c1ec5d88 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782240064.798971:0:14073:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fc2a8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14073:1868813758983680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782240064.799040:0:14073:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782240064.799087:0:14073:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c6125300 going to sleep for 11 seconds 00000100:00100000:3.0:1782240064.801520:0:14070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758983680 00000100:00100000:3.0:1782240064.801534:0:14070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758983680 00000100:00100000:3.0:1782240064.801584:0:14070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1782240064.801593:0:14070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f39b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+11:14073:x1868813758983680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782240064.801610:0:14070:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782240064.801642:0:14070:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb5f7e26c00/0x8c5345f1c1ec5d8f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c5345f1c1ec5d88 expref: -99 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240064.801671:0:14070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb5f7e26c00/0x8c5345f1c1ec5d8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c5345f1c1ec5d88 expref: 12 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240064.801681:0:14070:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb5f7e26c00/0x8c5345f1c1ec5d8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c5345f1c1ec5d88 expref: 12 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240064.801690:0:14070:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5f7e26c00, rc 0) 00000100:00100000:3.0:1782240064.801782:0:14070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f39b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+12:14073:x1868813758983680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 189us (2742us total) trans 0 rc 0/0 00000100:00100000:3.0:1782240064.801789:0:14070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1782240064.802015:0:14073:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fc2a8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14073:1868813758983680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782240064.802032:0:14073:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e38e00/0x8c5345f1c1ec5d88 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec5d8f expref: -99 pid: 14073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240064.802042:0:14073:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e38e00/0x8c5345f1c1ec5d88 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c5345f1c1ec5d8f expref: -99 pid: 14073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782240064.802110:0:14073:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fbe08a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14073:1868813758983808:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1782240064.802159:0:14073:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782240064.802192:0:14073:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c2c790c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782240064.802206:0:14068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758983808 00000100:00100000:2.0:1782240064.802209:0:14068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758983808 00000100:00100000:2.0:1782240064.802233:0:14068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1782240064.802239:0:14068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f39ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+12:14073:x1868813758983808:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1782240064.802253:0:14068:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1782240064.802268:0:14068:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1782240064.802271:0:14068:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1782240064.802358:0:14068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f39ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+12:14073:x1868813758983808:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 118us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1782240064.802365:0:14068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1782240064.802397:0:14073:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fbe08a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14073:1868813758983808:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1782240064.802442:0:14073:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1782240064.802449:0:14073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e38e00/0x8c5345f1c1ec5d88 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec5d8f expref: -99 pid: 14073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240064.802457:0:14073:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e38e00/0x8c5345f1c1ec5d88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec5d8f expref: -99 pid: 14073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240064.990952:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1782240065.573135:0:14110:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1782240066.015497:0:14064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782240067.041671:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782240068.063211:0:14064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1782240068.902626:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782240068.902632:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1782240068.902635:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782240068.902638:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1782240068.902654:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1782240068.902657:0:37:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1782240068.902661:0:37:0:(import.c:65:import_set_state_nolock()) ffff9bb5f4998000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1782240068.902672:0:37:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9bb5f4998000 using connection 192.168.203.132@tcp/0@lo 00000100:00100000:3.0:1782240068.902695:0:37:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bb5f4897100 x1868813758984064/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1782240068.902740:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782240068.902775:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f4894e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:3307:1868813758983936:0@lo:400:kworker.0 00000100:00100000:3.0:1782240068.902855:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782240068.902912:0:14068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758983936 00000100:00100000:3.0:1782240068.902920:0:14068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758983936 00000100:00100000:3.0:1782240068.903136:0:14068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1782240068.903146:0:14068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f39b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+12:3307:x1868813758983936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782240068.903193:0:14068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f39b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+12:3307:x1868813758983936:12345-0@lo:400:kworker.0 Request processed in 49us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1782240068.903200:0:14068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1782240068.903244:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f4894e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:3307:1868813758983936:0@lo:400:kworker.0 00000100:00100000:3.0:1782240068.903285:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f4897100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1868813758984064:0@lo:38:kworker.0 00000100:00100000:3.0:1782240068.903314:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782240068.903348:0:14078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758984064 00000100:00100000:3.0:1782240068.903351:0:14078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758984064 00000100:00100000:3.0:1782240068.903369:0:14078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782240068.903373:0:14078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f4894e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3303:x1868813758984064:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1782240068.903393:0:14078:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 447 last 0 00000020:00000080:3.0:1782240068.903422:0:14078:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x8c5345f1c1ec5d96 00000004:00100000:3.0:1782240068.903443:0:14078:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1782240068.903786:0:14078:0:(import.c:65:import_set_state_nolock()) ffff9bb5c84b6000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782240068.904343:0:14078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f4894e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1868813758984064:12345-0@lo:38:kworker.0 Request processed in 967us (1027us total) trans 0 rc 0/0 00000100:00100000:3.0:1782240068.904351:0:14078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1782240068.904392:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9bb5f4897100 x1868813758984064/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782240078 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1782240068.904404:0:3303:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1782240068.904411:0:3303:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1782240068.904416:0:3303:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1782240068.904418:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9bb5f4998000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1782240068.904423:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f4897100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1868813758984064:0@lo:38:kworker.0 00010000:00010000:1.0:1782240069.093582:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782240069.227030:0:14359:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg332-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1782240070.112397:0:14064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782240071.141065:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782240072.159697:0:14064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782240072.210704:0:14509:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe30923fc0 20000000:00000080:1.0:1782240072.210722:0:14509:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9bb5dee42800 uarg=0000000000000000 20000000:01000000:1.0:1782240072.210827:0:14509:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1782240072.210834:0:14509:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1782240072.210839:0:14509:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1782240072.212907:0:14510:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:0.0:1782240072.213078:0:14509:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1782240072.229031:0:14509:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1782240072.229064:0:14509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bb5f4437400/0x8c5345f1c1ec5d9d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240072.229082:0:14509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bb5ee29fc00/0x8c5345f1c1ec5d5e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c5345f1c1ec5d57 expref: 11 pid: 14068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240072.229091:0:14509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bb5f4437400/0x8c5345f1c1ec5d9d lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240072.229133:0:14509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bb5ee29fc00/0x8c5345f1c1ec5d5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8c5345f1c1ec5d57 expref: 11 pid: 14068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240072.229145:0:14509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bb5ee29fc00/0x8c5345f1c1ec5d5e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8c5345f1c1ec5d57 expref: 11 pid: 14068 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782240072.229158:0:14509:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f77a5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14509:1868813758984192:0@lo:104: 00000100:00100000:0.0:1782240072.229216:0:14509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782240072.229276:0:14509:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c4db7b40 going to sleep for 11 seconds 00000100:00100000:2.0:1782240072.230697:0:14060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758984192 00000100:00100000:2.0:1782240072.230708:0:14060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758984192 00000100:00100000:2.0:1782240072.230774:0:14060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782240072.230783:0:14060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f77a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+3:14509:x1868813758984192:12345-0@lo:104: 00010000:00010000:2.0:1782240072.230798:0:14060:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e39000/0x8c5345f1c1ec5d57 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c5345f1c1ec5d5e expref: -99 pid: 14058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240072.230896:0:14060:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782240072.230903:0:14060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f77a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+3:14509:x1868813758984192:12345-0@lo:104: Request processed in 121us (1687us total) trans 0 rc 0/0 00000100:00100000:2.0:1782240072.230910:0:14060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1782240072.230931:0:14065:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782240072.230936:0:14065:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e39000/0x8c5345f1c1ec5d57 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c5345f1c1ec5d5e expref: -99 pid: 14058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240072.230943:0:14065:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f7e39000 already unused, calling callback (ffffffffc1d0cc20) 10000000:00010000:2.0:1782240072.230947:0:14065:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e39000/0x8c5345f1c1ec5d57 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8c5345f1c1ec5d5e expref: -99 pid: 14058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240072.230955:0:14065:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e39000/0x8c5345f1c1ec5d57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8c5345f1c1ec5d5e expref: -99 pid: 14058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782240072.230962:0:14065:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e39000/0x8c5345f1c1ec5d57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8c5345f1c1ec5d5e expref: -99 pid: 14058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782240072.230967:0:14065:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1782240072.230999:0:14065:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e39000/0x8c5345f1c1ec5d57 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c5345f1c1ec5d5e expref: -99 pid: 14058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240072.231006:0:14065:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782240072.231027:0:14065:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e39000/0x8c5345f1c1ec5d57 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c5345f1c1ec5d5e expref: -99 pid: 14058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240072.231034:0:14065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e39000/0x8c5345f1c1ec5d57 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c5345f1c1ec5d5e expref: -99 pid: 14058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240072.231065:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782240072.231066:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782240072.231068:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782240072.231090:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fbe08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:3307:1868813758984320:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782240072.231125:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782240072.231177:0:14061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758984320 00000100:00100000:2.0:1782240072.231181:0:14061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758984320 00010000:00010000:2.0:1782240072.231198:0:14061:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bb5ee29fc00/0x8c5345f1c1ec5d5e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c5345f1c1ec5d57 expref: 12 pid: 14068 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782240072.231220:0:14061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782240072.231241:0:14061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fbe0b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+12:3307:x1868813758984320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782240072.231252:0:14061:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782240072.231258:0:14061:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bb5ee29fc00/0x8c5345f1c1ec5d5e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c5345f1c1ec5d57 expref: 12 pid: 14068 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240072.231268:0:14061:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bb5ee29fc00/0x8c5345f1c1ec5d5e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8c5345f1c1ec5d57 expref: 12 pid: 14068 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240072.231285:0:14061:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bb5f4437400/0x8c5345f1c1ec5d9d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240072.231293:0:14061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb5f4437400/0x8c5345f1c1ec5d9d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240072.231306:0:14061:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bb5f4437400/0x8c5345f1c1ec5d9d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240072.231313:0:14061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bb5f4437400/0x8c5345f1c1ec5d9d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240072.231325:0:14061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bb5f4437400/0x8c5345f1c1ec5d9d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240072.231331:0:14061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bb5f4437400/0x8c5345f1c1ec5d9d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240072.231336:0:14061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f4437400 already unused, calling callback (ffffffffc1728ce0) 00010000:00010000:2.0:1782240072.231340:0:14061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bb5f4437400/0x8c5345f1c1ec5d9d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240072.231347:0:14061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bb5f4437400/0x8c5345f1c1ec5d9d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240072.231356:0:14061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bb5f4437400/0x8c5345f1c1ec5d9d lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240072.231365:0:14061:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782240072.231394:0:14061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fbe0b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+12:3307:x1868813758984320:12345-0@lo:103:ldlm_bl.0 Request processed in 167us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1782240072.231400:0:14061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782240072.231434:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fbe08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:3307:1868813758984320:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782240072.234058:0:14509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb5ee29fc00/0x8c5345f1c1ec5d5e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8c5345f1c1ec5d57 expref: 11 pid: 14068 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782240072.234093:0:14509:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f77a5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14509:1868813758984192:0@lo:104: 00010000:00010000:0.0:1782240072.234114:0:14509:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bb5f4437400/0x8c5345f1c1ec5d9d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240072.234124:0:14509:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bb5f4437400/0x8c5345f1c1ec5d9d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240072.234131:0:14509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bb5f4437400/0x8c5345f1c1ec5d9d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240072.234137:0:14509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb5f4437400/0x8c5345f1c1ec5d9d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240073.184585:0:14064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782240074.015849:0:3303:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782240063/real 1782240063] req@ffff9bb5f77a5180 x1868813758981376/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782240073 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782240074.015881:0:3303:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9bb5f77a5180 x1868813758981376/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782240073 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782240074.015893:0:3303:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782240063/real 1782240063] req@ffff9bb5fc2a9500 x1868813758981248/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782240073 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782240074.015904:0:3303:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9bb5fc2a9500 x1868813758981248/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782240073 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1782240074.015951:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9bb5fbba2800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1782240074.016338:0:3303:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1782240074.016343:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f77a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1868813758981376:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1782240074.016351:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9bb601914000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1782240074.023162:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782240074.023169:0:37:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1782240074.023173:0:37:0:(import.c:65:import_set_state_nolock()) ffff9bb601914000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1782240074.023182:0:37:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 442 00000100:00080000:2.0:1782240074.023191:0:37:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1782240074.023199:0:37:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9bb601914000 using connection 192.168.203.132@tcp/0@lo 00000100:00100000:3.0:1782240074.023257:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fbe08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:3304:1868813758984448:0@lo:400:kworker.0 00000100:00100000:2.0:1782240074.023271:0:37:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bb5fbe0a300 x1868813758984576/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1782240074.023289:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782240074.023293:0:37:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1782240074.023296:0:37:0:(import.c:65:import_set_state_nolock()) ffff9bb5fbba2800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1782240074.023300:0:37:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 442 00000100:00080000:2.0:1782240074.023304:0:37:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1782240074.023308:0:37:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9bb5fbba2800 using connection 192.168.203.132@tcp/0@lo 00000100:00100000:2.0:1782240074.023324:0:37:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bb5fbe08000 x1868813758984704/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1782240074.023364:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fbe09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1868813758984832:0@lo:400:kworker.0 00000100:00100000:3.0:1782240074.023377:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782240074.023458:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782240074.023514:0:14076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758984832 00000100:00100000:2.0:1782240074.023533:0:14076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758984832 00000100:00100000:2.0:1782240074.023575:0:14076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782240074.023583:0:14076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fbe0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1868813758984832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782240074.023632:0:14076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fbe0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1868813758984832:12345-0@lo:400:kworker.0 Request processed in 50us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1782240074.023640:0:14076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1782240074.023678:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9bb5fbe09180 x1868813758984832/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782240090 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782240074.023691:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fbe09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1868813758984832:0@lo:400:kworker.0 00000100:00100000:3.0:1782240074.025390:0:14070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758984448 00000100:00100000:3.0:1782240074.025410:0:14070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758984448 00000100:00080000:1.0:1782240074.027545:0:3303:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1782240074.027557:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fc2a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1868813758981248:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1782240074.027627:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fbe0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1868813758984576:0@lo:8:kworker.0 00000400:00000100:1.0:1782240074.027687:0:3303:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1868813758984576 offset 0 length 520: 4 00000100:00100000:1.0:1782240074.027723:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fbe08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1868813758984704:0@lo:8:kworker.0 00000400:00000100:1.0:1782240074.027742:0:3303:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1868813758984704 offset 0 length 520: 4 00000100:00100000:3.0:1782240074.034033:0:14068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1782240074.034060:0:14068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f39ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+11:3304:x1868813758984448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782240074.035086:0:14068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f39ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+11:3304:x1868813758984448:12345-0@lo:400:kworker.0 Request processed in 1032us (11704us total) trans 0 rc 0/0 00000100:00100000:3.0:1782240074.035100:0:14068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1782240074.035726:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fbe08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:3304:1868813758984448:0@lo:400:kworker.0 00010000:00010000:2.0:1782240074.206885:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1782240074.208651:0:14073:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1782240074.208658:0:14073:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9bb5d204d000 from 10 10000000:01000000:3.0:1782240074.208671:0:14073:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1782240074.208714:0:14073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e27000/0x8c5345f1c1ec5da4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240074.208726:0:14073:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e27000/0x8c5345f1c1ec5da4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240074.208736:0:14073:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e27000/0x8c5345f1c1ec5da4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782240074.209154:0:14073:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f4897100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14073:1868813758984960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782240074.209242:0:14073:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782240074.209334:0:14073:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c2ddc480 going to sleep for 11 seconds 00000100:00100000:2.0:1782240074.215782:0:14071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758984960 00000100:00100000:2.0:1782240074.215798:0:14071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758984960 00000100:00100000:2.0:1782240074.215879:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1782240074.215889:0:14071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f39bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+11:14073:x1868813758984960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782240074.215906:0:14071:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782240074.215925:0:14071:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb5ee29f400/0x8c5345f1c1ec5dab lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c5345f1c1ec5da4 expref: -99 pid: 14071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240074.215952:0:14071:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb5ee29f400/0x8c5345f1c1ec5dab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c5345f1c1ec5da4 expref: 12 pid: 14071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240074.215964:0:14071:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb5ee29f400/0x8c5345f1c1ec5dab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c5345f1c1ec5da4 expref: 12 pid: 14071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240074.215974:0:14071:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5ee29f400, rc 0) 00000100:00100000:2.0:1782240074.216047:0:14071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f39bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+12:14073:x1868813758984960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 159us (6805us total) trans 0 rc 0/0 00000100:00100000:2.0:1782240074.216055:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1782240074.216204:0:14073:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f4897100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14073:1868813758984960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782240074.216231:0:14073:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e27000/0x8c5345f1c1ec5da4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec5dab expref: -99 pid: 14073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240074.216241:0:14073:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e27000/0x8c5345f1c1ec5da4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c5345f1c1ec5dab expref: -99 pid: 14073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782240074.216306:0:14073:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f77a5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14073:1868813758985088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782240074.216340:0:14073:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782240074.216376:0:14073:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c4db70c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782240074.216492:0:14068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758985088 00000100:00100000:3.0:1782240074.216497:0:14068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758985088 00000100:00100000:3.0:1782240074.216539:0:14068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1782240074.216546:0:14068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f39ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+12:14073:x1868813758985088:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782240074.216799:0:14068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f39ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+12:14073:x1868813758985088:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 253us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1782240074.216806:0:14068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1782240074.216942:0:14073:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f77a5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14073:1868813758985088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782240074.216975:0:14073:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fc2a9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14073:1868813758985216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782240074.217016:0:14073:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782240074.217044:0:14073:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5e8d3f600 going to sleep for 11 seconds 00000100:00100000:0.0:1782240074.217095:0:14071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758985216 00000100:00100000:0.0:1782240074.217099:0:14071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758985216 00000100:00100000:0.0:1782240074.217119:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1782240074.217125:0:14071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f39bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+12:14073:x1868813758985216:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782240074.217291:0:14071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f39bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+12:14073:x1868813758985216:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 165us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1782240074.217297:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1782240074.217368:0:14073:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fc2a9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14073:1868813758985216:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1782240074.223273:0:14577:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1782240074.223509:0:14073:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1782240074.223543:0:14073:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1782240074.223555:0:14073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e27000/0x8c5345f1c1ec5da4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec5dab expref: -99 pid: 14073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240074.223567:0:14073:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e27000/0x8c5345f1c1ec5da4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec5dab expref: -99 pid: 14073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240075.231902:0:14064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1782240075.808674:0:14110:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1782240076.254922:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1782240076.509792:0:14710:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:2.0:1782240076.509795:0:14710:0:(obd_mount.c:917:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1782240076.509896:0:14710:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9bb5f499d800 00000020:01000004:2.0:1782240076.509909:0:14710:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1782240076.509917:0:14710:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1782240076.509928:0:14710:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9bb5ef21cd40) 00000020:00000080:2.0:1782240076.509938:0:14710:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1782240076.523093:0:14710:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1782240076.523321:0:14710:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1782240076.524187:0:14710:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1782240076.524435:0:14710:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1782240076.524685:0:14710:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1782240076.525161:0:14710:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 579: rc = 0 00100000:10000000:3.0:1782240076.525273:0:14710:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 579: rc = 0 00100000:10000000:3.0:1782240076.525372:0:14710:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 579: rc = 0 00100000:10000000:3.0:1782240076.525881:0:14710:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 661: rc = 0 00100000:10000000:3.0:1782240076.526230:0:14710:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 661: rc = 0 00100000:10000000:3.0:1782240076.526556:0:14710:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 661: rc = 0 00100000:10000000:3.0:1782240076.526963:0:14710:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 661: rc = 0 00100000:10000000:3.0:1782240076.527233:0:14710:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 661: rc = 0 00100000:10000000:3.0:1782240076.527548:0:14710:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 661: rc = 0 00000020:00000080:3.0:1782240076.528323:0:14710:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1782240076.528333:0:14710:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1782240076.528344:0:14710:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x8c5345f1c1ec5db9 00000020:01000004:3.0:1782240076.528352:0:14710:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1782240076.528371:0:14710:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.203.132@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1782240076.528375:0:14710:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.132@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1782240076.528381:0:14710:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1782240076.528386:0:14710:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1782240076.528397:0:14710:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9bb5ded00000) 00000020:00000080:3.0:1782240076.528408:0:14710:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:3.0:1782240076.535123:0:14710:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1782240076.535700:0:14710:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1782240076.535707:0:14710:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1782240076.536594:0:14710:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1782240076.536602:0:14710:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1782240076.536942:0:14710:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1782240076.536948:0:14710:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1782240076.540427:0:14710:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1782240076.540666:0:14710:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1782240076.540672:0:14710:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1782240076.541344:0:14710:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1782240076.541351:0:14710:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1782240076.564075:0:14710:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1782240076.564317:0:14710:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1782240076.564324:0:14710:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1782240076.566048:0:14710:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1782240076.566072:0:14710:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1782240076.567065:0:14710:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1782240076.567075:0:14710:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1782240076.569608:0:14710:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1782240076.570011:0:14710:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1782240076.570017:0:14710:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1782240076.571315:0:14710:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1782240076.571325:0:14710:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1782240076.601518:0:14710:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1782240076.601687:0:14710:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1782240076.601694:0:14710:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1782240076.603904:0:14710:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1782240076.603919:0:14710:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1782240076.605255:0:14710:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1782240076.605280:0:14710:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1782240076.605286:0:14710:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.132@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1782240076.635116:0:14710:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.132@tcp ctxt 0 is initialized 00000020:01000004:2.0:1782240076.635158:0:14710:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.132@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1782240076.635163:0:14710:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1782240076.635164:0:14710:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1782240076.635166:0:14710:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782240076.635167:0:14710:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782240076.635168:0:14710:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782240076.635174:0:14710:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782240076.635176:0:14710:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782240076.635177:0:14710:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782240076.635178:0:14710:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1782240076.635181:0:14710:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1782240076.635183:0:14710:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1782240076.635184:0:14710:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1782240076.635185:0:14710:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782240076.635186:0:14710:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782240076.635187:0:14710:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782240076.635187:0:14710:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782240076.635188:0:14710:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782240076.635189:0:14710:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782240076.635190:0:14710:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1782240076.635226:0:14710:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1782240076.635245:0:14710:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fbe09180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14710:1868813758985344:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1782240076.635323:0:14710:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782240076.635368:0:14710:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c6125180 going to sleep for 11 seconds 00000100:00100000:0.0:1782240076.636277:0:14071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758985344 00000100:00100000:0.0:1782240076.636288:0:14071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758985344 00000100:00100000:0.0:1782240076.636345:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1782240076.636354:0:14071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f39bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+12:14710:x1868813758985344:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1782240076.636396:0:14071:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1782240076.636400:0:14071:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1782240076.636403:0:14071:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1782240076.652451:0:14071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f39bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+12:14710:x1868813758985344:12345-0@lo:253:mount.lustre.0 Request processed in 16089us (17119us total) trans 0 rc 0/0 00000100:00100000:1.0:1782240076.652632:0:14710:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fbe09180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14710:1868813758985344:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1782240076.652704:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 10000000:01000000:1.0:1782240076.652850:0:14710:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1782240076.652853:0:14710:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1782240076.652855:0:14710:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1782240076.652857:0:14710:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782240076.652858:0:14710:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1782240076.652859:0:14710:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782240076.652860:0:14710:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782240076.652862:0:14710:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1782240076.652864:0:14710:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782240076.652865:0:14710:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1782240076.652973:0:14710:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9bb5f499d800 from lustre-OST0000 10000000:01000000:1.0:1782240076.653004:0:14710:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1782240076.653007:0:14710:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1782240076.653013:0:14710:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9bb5ef7ab380 local copy 00010000:00010000:1.0:1782240076.653024:0:14710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e26a00/0x8c5345f1c1ec5caf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec5cb6 expref: -99 pid: 14058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782240076.653270:0:14710:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fc2a9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14710:1868813758985472:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782240076.653319:0:14710:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782240076.653405:0:14710:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c50a6b40 going to sleep for 11 seconds 00000100:00100000:3.0:1782240076.653454:0:14068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758985472 00000100:00100000:3.0:1782240076.653961:0:14068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758985472 00000100:00100000:3.0:1782240076.654016:0:14068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1782240076.654024:0:14068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d81c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+12:14710:x1868813758985472:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782240076.654337:0:14068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d81c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+12:14710:x1868813758985472:12345-0@lo:501:mount.lustre.0 Request processed in 313us (1016us total) trans 0 rc -2/-2 00000100:00100000:3.0:1782240076.654345:0:14068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1782240076.654408:0:14710:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fc2a9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14710:1868813758985472:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1782240076.654425:0:14710:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.132@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1782240076.654594:0:14710:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.132@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1782240076.654602:0:14710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e26a00/0x8c5345f1c1ec5caf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec5cb6 expref: -99 pid: 14058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240076.654612:0:14710:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e26a00/0x8c5345f1c1ec5caf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec5cb6 expref: -99 pid: 14058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782240076.654634:0:14710:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9bb5f499d800 10000000:01000000:1.0:1782240076.654836:0:14710:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1782240076.654844:0:14710:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9bb5ef7ab380 10000000:01000000:1.0:1782240076.654847:0:14710:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1782240076.654851:0:14710:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff9bb5ef7ab380 from 1 10000000:01000000:1.0:1782240076.654854:0:14710:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1782240076.654951:0:14710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e39c00/0x8c5345f1c1ec5dc7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240076.654961:0:14710:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e39c00/0x8c5345f1c1ec5dc7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240076.654971:0:14710:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e39c00/0x8c5345f1c1ec5dc7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782240076.654988:0:14710:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fc2a9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14710:1868813758985600:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1782240076.655022:0:14710:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782240076.655112:0:14710:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c50a6b40 going to sleep for 11 seconds 00000100:00100000:2.0:1782240076.655156:0:14071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758985600 00000100:00100000:2.0:1782240076.655162:0:14071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758985600 00000100:00100000:2.0:1782240076.655245:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1782240076.655254:0:14071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d81c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+12:14710:x1868813758985600:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1782240076.655265:0:14071:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782240076.655278:0:14071:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb5ee29e600/0x8c5345f1c1ec5dce lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c5345f1c1ec5dc7 expref: -99 pid: 14071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240076.655300:0:14071:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb5ee29e600/0x8c5345f1c1ec5dce lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c5345f1c1ec5dc7 expref: 13 pid: 14071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240076.655310:0:14071:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb5ee29e600/0x8c5345f1c1ec5dce lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c5345f1c1ec5dc7 expref: 13 pid: 14071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240076.655325:0:14071:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5ee29e600, rc 0) 00000100:00100000:2.0:1782240076.655412:0:14071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d81c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+13:14710:x1868813758985600:12345-0@lo:101:mount.lustre.0 Request processed in 159us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1782240076.655419:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1782240076.655553:0:14710:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fc2a9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14710:1868813758985600:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782240076.655567:0:14710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e39c00/0x8c5345f1c1ec5dc7 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec5dce expref: -99 pid: 14710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240076.655577:0:14710:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e39c00/0x8c5345f1c1ec5dc7 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c5345f1c1ec5dce expref: -99 pid: 14710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782240076.655593:0:14710:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1782240076.655662:0:14710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e39c00/0x8c5345f1c1ec5dc7 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec5dce expref: -99 pid: 14710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240076.655671:0:14710:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e39c00/0x8c5345f1c1ec5dc7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec5dce expref: -99 pid: 14710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782240076.655678:0:14710:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1782240076.655683:0:14710:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1782240076.655687:0:14710:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1782240076.655690:0:14710:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1782240076.655707:0:14710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e39800/0x8c5345f1c1ec5dd5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240076.655715:0:14710:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e39800/0x8c5345f1c1ec5dd5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240076.655723:0:14710:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e39800/0x8c5345f1c1ec5dd5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782240076.655737:0:14710:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fc2a9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14710:1868813758985728:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1782240076.656483:0:14710:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782240076.656574:0:14710:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c50a6b40 going to sleep for 11 seconds 00000100:00100000:2.0:1782240076.658433:0:14071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758985728 00000100:00100000:2.0:1782240076.658445:0:14071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758985728 00000100:00100000:2.0:1782240076.659126:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1782240076.659136:0:14071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d81c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+13:14710:x1868813758985728:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1782240076.659152:0:14071:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782240076.659170:0:14071:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb5ee29f000/0x8c5345f1c1ec5ddc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c5345f1c1ec5dd5 expref: -99 pid: 14071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240076.659204:0:14071:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb5ee29f000/0x8c5345f1c1ec5ddc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c5345f1c1ec5dd5 expref: 14 pid: 14071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240076.659216:0:14071:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb5ee29f000/0x8c5345f1c1ec5ddc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c5345f1c1ec5dd5 expref: 14 pid: 14071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240076.659224:0:14071:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5ee29f000, rc 0) 00000100:00100000:2.0:1782240076.659289:0:14071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d81c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+14:14710:x1868813758985728:12345-0@lo:101:mount.lustre.0 Request processed in 155us (2808us total) trans 0 rc 0/0 00000100:00100000:2.0:1782240076.659296:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1782240076.659408:0:14710:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fc2a9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14710:1868813758985728:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782240076.659426:0:14710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e39800/0x8c5345f1c1ec5dd5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec5ddc expref: -99 pid: 14710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240076.659435:0:14710:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e39800/0x8c5345f1c1ec5dd5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c5345f1c1ec5ddc expref: -99 pid: 14710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782240076.660136:0:14710:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1782240076.660962:0:14710:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1782240076.661221:0:14710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1782240076.661267:0:14710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1782240076.661313:0:14710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1782240076.661360:0:14710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1782240076.661393:0:14710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1782240076.661427:0:14710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1782240076.661489:0:14710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1782240076.661498:0:14710:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1782240076.661566:0:14710:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fc2a9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14710:1868813758985856:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782240076.661621:0:14710:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782240076.661655:0:14710:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c50a6600 going to sleep for 11 seconds 00000100:00100000:2.0:1782240076.662010:0:14071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758985856 00000100:00100000:2.0:1782240076.662016:0:14071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758985856 00000100:00100000:2.0:1782240076.662056:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1782240076.662065:0:14071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d81c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+14:14710:x1868813758985856:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1782240076.662404:0:14071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d81c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+14:14710:x1868813758985856:12345-0@lo:501:mount.lustre.0 Request processed in 338us (782us total) trans 0 rc 0/0 00000100:00100000:2.0:1782240076.662419:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1782240076.662857:0:14710:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fc2a9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14710:1868813758985856:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782240076.662892:0:14710:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fc2a9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14710:1868813758985984:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1782240076.662934:0:14710:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782240076.662999:0:14710:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c50a6600 going to sleep for 11 seconds 00000100:00100000:2.0:1782240076.663166:0:14071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758985984 00000100:00100000:2.0:1782240076.663171:0:14071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758985984 00000100:00100000:2.0:1782240076.663244:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1782240076.663251:0:14071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d81c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+14:14710:x1868813758985984:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1782240076.663681:0:14071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d81c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+14:14710:x1868813758985984:12345-0@lo:503:mount.lustre.0 Request processed in 430us (746us total) trans 0 rc 0/0 00000100:00100000:2.0:1782240076.663689:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1782240076.663796:0:14710:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fc2a9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14710:1868813758985984:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1782240076.664402:0:14710:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1782240076.664485:0:14710:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fc2a9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14710:1868813758986112:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1782240076.664535:0:14710:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782240076.665210:0:14710:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c50a6600 going to sleep for 11 seconds 00000100:00100000:3.0:1782240076.665313:0:14068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758986112 00000100:00100000:3.0:1782240076.665320:0:14068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758986112 00000100:00100000:3.0:1782240076.665354:0:14068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1782240076.665361:0:14068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d81c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+14:14710:x1868813758986112:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782240076.665603:0:14068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d81c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+14:14710:x1868813758986112:12345-0@lo:502:mount.lustre.0 Request processed in 241us (1067us total) trans 0 rc 0/0 00000100:00100000:3.0:1782240076.665611:0:14068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1782240076.665833:0:14710:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fc2a9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14710:1868813758986112:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1782240076.666114:0:14710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1782240076.666167:0:14710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1782240076.666218:0:14710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1782240076.666270:0:14710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1782240076.666309:0:14710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1782240076.666344:0:14710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1782240076.666391:0:14710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1782240076.666432:0:14710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1782240076.666498:0:14710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:1.0:1782240076.666553:0:14710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:1.0:1782240076.666591:0:14710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:1.0:1782240076.666640:0:14710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:1.0:1782240076.666676:0:14710:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fc2a9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14710:1868813758986240:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1782240076.666733:0:14710:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782240076.666760:0:14071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758986240 00000100:00100000:1.0:1782240076.666786:0:14710:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c50a6600 going to sleep for 11 seconds 00000100:00100000:2.0:1782240076.667042:0:14071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758986240 00000100:00100000:2.0:1782240076.667076:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1782240076.667082:0:14071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d81c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+14:14710:x1868813758986240:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1782240076.667328:0:14071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d81c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+14:14710:x1868813758986240:12345-0@lo:502:mount.lustre.0 Request processed in 244us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1782240076.667336:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1782240076.669517:0:14710:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fc2a9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14710:1868813758986240:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1782240076.669658:0:14710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:1.0:1782240076.669675:0:14710:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:2.0:1782240076.672827:0:14724:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1782240076.672840:0:14724:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1782240076.672847:0:14724:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782240076.672850:0:14724:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1782240076.672856:0:14724:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1782240076.672873:0:14724:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9bb5ef21b380) 00000020:00000080:2.0:1782240076.672897:0:14724:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:2.0:1782240076.672903:0:14724:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1782240076.672970:0:14724:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bb5f499d800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1782240076.672979:0:14724:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1782240076.672985:0:14724:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x8c5345f1c1ec5dea 00010000:00010000:3.0:1782240076.679994:0:14724:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:3.0:1782240076.680390:0:14724:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:3.0:1782240076.682573:0:14724:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1782240076.684727:0:14724:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1782240076.684739:0:14724:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782240076.684875:0:14724:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782240076.684878:0:14724:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1782240076.684888:0:14724:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1782240076.684891:0:14724:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #16 00000020:01000000:0.0:1782240076.684892:0:14724:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1782240076.684894:0:14724:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1782240076.684895:0:14724:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1782240076.686728:0:14724:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782240076.686734:0:14724:0:(obd_config.c:1561:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:1.0:1782240076.686744:0:14724:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782240076.686773:0:14724:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782240076.686775:0:14724:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:1.0:1782240076.686779:0:14724:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1782240076.686782:0:14724:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1782240076.686785:0:14724:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782240076.686787:0:14724:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782240076.686803:0:14724:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:1.0:1782240076.686806:0:14724:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782240076.686809:0:14724:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782240076.686810:0:14724:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1782240076.686813:0:14724:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1782240076.686877:0:14724:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782240076.686880:0:14724:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782240076.686881:0:14724:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1782240076.686884:0:14724:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:2.0:1782240076.687076:0:14710:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1782240076.687102:0:14710:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1782240076.687133:0:14710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e39800/0x8c5345f1c1ec5dd5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec5ddc expref: -99 pid: 14710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240076.687145:0:14710:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e39800/0x8c5345f1c1ec5dd5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec5ddc expref: -99 pid: 14710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782240076.687153:0:14710:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9bb5f499d800 from 1 10000000:01000000:2.0:1782240076.687155:0:14710:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1782240076.687188:0:14710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5ee29f600/0x8c5345f1c1ec5df1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240076.687206:0:14710:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: ffff9bb5ee29f600/0x8c5345f1c1ec5df1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240076.687217:0:14710:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff9bb5ee29f600/0x8c5345f1c1ec5df1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782240076.687240:0:14710:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fbe0a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14710:1868813758986368:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1782240076.687300:0:14710:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782240076.687342:0:14710:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5e8ee3840 going to sleep for 11 seconds 00000100:00100000:1.0:1782240076.687591:0:14071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758986368 00000100:00100000:1.0:1782240076.687599:0:14071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758986368 00000100:00100000:1.0:1782240076.687643:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1782240076.687651:0:14071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d81c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+14:14710:x1868813758986368:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782240076.687665:0:14071:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782240076.687678:0:14071:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb5f7e38400/0x8c5345f1c1ec5df8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c5345f1c1ec5df1 expref: -99 pid: 14071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240076.687699:0:14071:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb5f7e38400/0x8c5345f1c1ec5df8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c5345f1c1ec5df1 expref: 15 pid: 14071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240076.687709:0:14071:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb5f7e38400/0x8c5345f1c1ec5df8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c5345f1c1ec5df1 expref: 15 pid: 14071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240076.687716:0:14071:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5f7e38400, rc 0) 00000100:00100000:1.0:1782240076.687797:0:14071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d81c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+15:14710:x1868813758986368:12345-0@lo:101:mount.lustre.0 Request processed in 146us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1782240076.687803:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1782240076.687866:0:14710:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fbe0a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14710:1868813758986368:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782240076.687879:0:14710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff9bb5ee29f600/0x8c5345f1c1ec5df1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec5df8 expref: -99 pid: 14710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240076.687899:0:14710:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff9bb5ee29f600/0x8c5345f1c1ec5df1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c5345f1c1ec5df8 expref: -99 pid: 14710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782240076.688350:0:14710:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1782240076.688632:0:14710:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1782240076.688907:0:14710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1782240076.688952:0:14710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1782240076.689016:0:14710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1782240076.689024:0:14710:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1782240076.689079:0:14710:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fc2a9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14710:1868813758986496:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782240076.689119:0:14710:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782240076.689140:0:14710:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c50a6480 going to sleep for 11 seconds 00000100:00100000:1.0:1782240076.689160:0:14070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758986496 00000100:00100000:1.0:1782240076.689164:0:14070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758986496 00000100:00100000:1.0:1782240076.689207:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1782240076.689214:0:14071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d81c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+15:14710:x1868813758986496:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782240076.689392:0:14071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d81c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+15:14710:x1868813758986496:12345-0@lo:501:mount.lustre.0 Request processed in 178us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1782240076.689399:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1782240076.689453:0:14710:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fc2a9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14710:1868813758986496:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782240076.689480:0:14710:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fc2a9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14710:1868813758986624:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1782240076.689517:0:14710:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782240076.689536:0:14071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758986624 00000100:00100000:1.0:1782240076.689540:0:14071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758986624 00000100:00100000:1.0:1782240076.689558:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1782240076.689564:0:14071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d81c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+15:14710:x1868813758986624:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1782240076.689685:0:14071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d81c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+15:14710:x1868813758986624:12345-0@lo:503:mount.lustre.0 Request processed in 121us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1782240076.689691:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1782240076.689721:0:14710:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c50a6480 going to sleep for 11 seconds 00000100:00100000:1.0:1782240076.689733:0:14710:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fc2a9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14710:1868813758986624:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1782240076.690116:0:14710:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1782240076.690164:0:14710:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fc2a9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14710:1868813758986752:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1782240076.690214:0:14710:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782240076.690240:0:14071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758986752 00000100:00100000:1.0:1782240076.690244:0:14071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758986752 00000100:00100000:1.0:1782240076.690267:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1782240076.690273:0:14071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d81c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+15:14710:x1868813758986752:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1782240076.690405:0:14071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d81c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+15:14710:x1868813758986752:12345-0@lo:502:mount.lustre.0 Request processed in 131us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1782240076.690412:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1782240076.690445:0:14710:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c7e7c480 going to sleep for 11 seconds 00000100:00100000:1.0:1782240076.690458:0:14710:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fc2a9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14710:1868813758986752:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1782240076.690676:0:14710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1782240076.690733:0:14710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1782240076.690828:0:14710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1782240076.690868:0:14710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1782240076.690903:0:14710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1782240076.690951:0:14710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1782240076.690986:0:14710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1782240076.691020:0:14710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1782240076.691046:0:14710:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fc2a9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14710:1868813758986880:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1782240076.691089:0:14710:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782240076.691117:0:14071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758986880 00000100:00100000:1.0:1782240076.691122:0:14071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758986880 00000100:00100000:1.0:1782240076.691148:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1782240076.691154:0:14071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d81c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+15:14710:x1868813758986880:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1782240076.693797:0:14710:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c7e7c480 going to sleep for 11 seconds 00000100:00100000:1.0:1782240076.699918:0:14071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d81c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+15:14710:x1868813758986880:12345-0@lo:502:mount.lustre.0 Request processed in 8755us (8819us total) trans 0 rc 0/0 00000100:00100000:1.0:1782240076.699931:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1782240076.701026:0:14710:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fc2a9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14710:1868813758986880:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1782240076.701271:0:14710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1782240076.701289:0:14710:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1782240076.702392:0:14728:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782240076.702403:0:14728:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782240076.702405:0:14728:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1782240076.702411:0:14728:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bb5f499d800 00000020:00000080:2.0:1782240076.702413:0:14728:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1782240076.702420:0:14728:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782240076.702422:0:14728:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782240076.702424:0:14728:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1782240076.702426:0:14728:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782240076.702428:0:14728:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782240076.702435:0:14728:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1782240076.702439:0:14728:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bb5f499d800 00000020:00000080:2.0:1782240076.702441:0:14728:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1782240076.703719:0:14728:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782240076.703728:0:14728:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782240076.703729:0:14728:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1782240076.703733:0:14728:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782240076.703737:0:14728:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782240076.703738:0:14728:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1782240076.703743:0:14728:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9bb5f499d800 00000020:00000080:2.0:1782240076.704560:0:14728:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1782240076.704997:0:14728:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782240076.705004:0:14728:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782240076.705006:0:14728:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1782240076.705010:0:14728:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1782240076.712440:0:14710:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1782240076.712927:0:14710:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1782240076.712956:0:14710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5ee29f600/0x8c5345f1c1ec5df1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec5df8 expref: -99 pid: 14710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240076.712969:0:14710:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff9bb5ee29f600/0x8c5345f1c1ec5df1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec5df8 expref: -99 pid: 14710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782240076.713019:0:14710:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1782240076.713022:0:14710:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9bb5f499d800 10000000:01000000:3.0:1782240076.713026:0:14710:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9bb5f499d800 10000000:01000000:3.0:1782240076.713029:0:14710:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1782240076.713035:0:14710:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9bb5f499d800 from 1 10000000:01000000:3.0:1782240076.713047:0:14710:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1782240076.713157:0:14710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e26000/0x8c5345f1c1ec5dff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240076.713167:0:14710:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e26000/0x8c5345f1c1ec5dff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240076.713178:0:14710:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e26000/0x8c5345f1c1ec5dff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782240076.713212:0:14710:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f4897800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14710:1868813758987008:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1782240076.713280:0:14710:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782240076.713318:0:14710:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c4d89300 going to sleep for 11 seconds 00000100:00100000:2.0:1782240076.713653:0:14068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758987008 00000100:00100000:2.0:1782240076.713661:0:14068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758987008 00000100:00100000:2.0:1782240076.713705:0:14068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1782240076.713714:0:14068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d81c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+15:14710:x1868813758987008:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1782240076.713728:0:14068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782240076.713741:0:14068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb5ee29fe00/0x8c5345f1c1ec5e06 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c5345f1c1ec5dff expref: -99 pid: 14068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240076.714508:0:14068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb5ee29fe00/0x8c5345f1c1ec5e06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c5345f1c1ec5dff expref: 16 pid: 14068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240076.714521:0:14068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb5ee29fe00/0x8c5345f1c1ec5e06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c5345f1c1ec5dff expref: 16 pid: 14068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240076.714530:0:14068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5ee29fe00, rc 0) 00000100:00100000:2.0:1782240076.714592:0:14068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d81c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+16:14710:x1868813758987008:12345-0@lo:101:mount.lustre.0 Request processed in 878us (1311us total) trans 0 rc 0/0 00000100:00100000:2.0:1782240076.714608:0:14068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1782240076.715240:0:14710:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f4897800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14710:1868813758987008:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1782240076.715261:0:14710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e26000/0x8c5345f1c1ec5dff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec5e06 expref: -99 pid: 14710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240076.715272:0:14710:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e26000/0x8c5345f1c1ec5dff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c5345f1c1ec5e06 expref: -99 pid: 14710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782240076.722493:0:14710:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:2.0:1782240076.723655:0:14710:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1782240076.725670:0:14710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1782240076.726893:0:14710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1782240076.726974:0:14710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1782240076.727039:0:14710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1782240076.727900:0:14710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1782240076.727973:0:14710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1782240076.728014:0:14710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1782240076.728049:0:14710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1782240076.728328:0:14710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1782240076.728365:0:14710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1782240076.728403:0:14710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1782240076.728456:0:14710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1782240076.728493:0:14710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1782240076.728529:0:14710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1782240076.728579:0:14710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1782240076.728619:0:14710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1782240076.728654:0:14710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1782240076.728705:0:14710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1782240076.730974:0:14710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1782240076.731048:0:14710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1782240076.731130:0:14710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1782240076.731165:0:14710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1782240076.731209:0:14710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1782240076.731257:0:14710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1782240076.731291:0:14710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1782240076.731322:0:14710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1782240076.731365:0:14710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1782240076.731401:0:14710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1782240076.731519:0:14710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1782240076.731527:0:14710:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:3.0:1782240076.731636:0:14710:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f4897800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14710:1868813758987136:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782240076.731703:0:14710:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782240076.731743:0:14710:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c7f79f00 going to sleep for 11 seconds 00000100:00100000:1.0:1782240076.732886:0:14071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758987136 00000100:00100000:1.0:1782240076.732895:0:14071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758987136 00000100:00100000:1.0:1782240076.732946:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1782240076.732956:0:14071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d81c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+16:14710:x1868813758987136:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782240076.733435:0:14071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d81c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+16:14710:x1868813758987136:12345-0@lo:501:mount.lustre.0 Request processed in 479us (1731us total) trans 0 rc 0/0 00000100:00100000:1.0:1782240076.733444:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1782240076.748439:0:14710:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f4897800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14710:1868813758987136:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782240076.748565:0:14710:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f4897800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14710:1868813758987264:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1782240076.748639:0:14710:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782240076.748681:0:14710:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c7f79d80 going to sleep for 11 seconds 00000100:00100000:2.0:1782240076.748735:0:14068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758987264 00000100:00100000:2.0:1782240076.748742:0:14068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758987264 00000100:00100000:2.0:1782240076.748812:0:14068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1782240076.748821:0:14068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d81c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+16:14710:x1868813758987264:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1782240076.749107:0:14068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d81c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+16:14710:x1868813758987264:12345-0@lo:503:mount.lustre.0 Request processed in 286us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1782240076.749115:0:14068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1782240076.749280:0:14710:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f4897800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14710:1868813758987264:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1782240076.749793:0:14710:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1782240076.749858:0:14710:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f4897800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14710:1868813758987392:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782240076.749900:0:14710:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782240076.749928:0:14710:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c7f79d80 going to sleep for 11 seconds 00000100:00100000:2.0:1782240076.750155:0:14071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758987392 00000100:00100000:2.0:1782240076.750160:0:14071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758987392 00000100:00100000:2.0:1782240076.750205:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1782240076.750213:0:14071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc0bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+16:14710:x1868813758987392:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1782240076.750460:0:14071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc0bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+16:14710:x1868813758987392:12345-0@lo:502:mount.lustre.0 Request processed in 247us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1782240076.750468:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1782240076.750515:0:14710:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f4897800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14710:1868813758987392:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1782240076.750781:0:14710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1782240076.750830:0:14710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1782240076.750864:0:14710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1782240076.750910:0:14710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1782240076.750947:0:14710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1782240076.751020:0:14710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1782240076.754413:0:14710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1782240076.754523:0:14710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1782240076.754602:0:14710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1782240076.754640:0:14710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1782240076.754674:0:14710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1782240076.754742:0:14710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1782240076.754822:0:14710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1782240076.754861:0:14710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1782240076.754905:0:14710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1782240076.754954:0:14710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1782240076.754989:0:14710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1782240076.760071:0:14710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1782240076.760132:0:14710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1782240076.760169:0:14710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1782240076.760231:0:14710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1782240076.760270:0:14710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1782240076.760305:0:14710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1782240076.760351:0:14710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1782240076.760389:0:14710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1782240076.760426:0:14710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1782240076.760495:0:14710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1782240076.760535:0:14710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1782240076.760573:0:14710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1782240076.760626:0:14710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1782240076.760686:0:14710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1782240076.760721:0:14710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1782240076.760783:0:14710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1782240076.760846:0:14710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1782240076.760886:0:14710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1782240076.760933:0:14710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1782240076.760971:0:14710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1782240076.761005:0:14710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1782240076.761057:0:14710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1782240076.761093:0:14710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1782240076.761145:0:14710:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f4895180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14710:1868813758987520:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782240076.761237:0:14710:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782240076.761289:0:14070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758987520 00000100:00100000:3.0:1782240076.761297:0:14070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758987520 00000100:00100000:3.0:1782240076.761338:0:14070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1782240076.761346:0:14070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc0bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+16:14710:x1868813758987520:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782240076.761567:0:14070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc0bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+16:14710:x1868813758987520:12345-0@lo:502:mount.lustre.0 Request processed in 220us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1782240076.761575:0:14070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1782240076.761627:0:14710:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c7f79240 going to sleep for 11 seconds 00000100:00100000:3.0:1782240076.761649:0:14710:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f4895180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14710:1868813758987520:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1782240076.761712:0:14710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1782240076.761722:0:14710:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1782240076.763939:0:14733:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1782240076.763957:0:14733:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9bb601828000) 00000020:00000080:1.0:1782240076.763977:0:14733:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:1.0:1782240076.764188:0:14733:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bb5f499d800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1782240076.764202:0:14733:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bb5f499d800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1782240076.764204:0:14733:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9bb5f499d800 3 00010000:00080000:1.0:1782240076.764233:0:14733:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bb5c8d70000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.132@tcp at head 00010000:00010000:1.0:1782240076.770204:0:14733:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:1.0:1782240076.770314:0:14733:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1782240076.770355:0:14733:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1782240076.770381:0:14733:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x8c5345f1c1ec5e14 00000100:00080000:1.0:1782240076.770391:0:14733:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1782240076.770397:0:14733:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bb5c8d70000 using connection 192.168.203.132@tcp/0@lo 00000100:00100000:1.0:1782240076.770431:0:14733:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bb5fc2ab800 x1868813758987648/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1782240076.770480:0:14733:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1782240076.770513:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1782240076.770517:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1782240076.770519:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1782240076.770522:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1782240076.770569:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fc2a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1868813758987776:0@lo:400:kworker.0 00000100:00100000:1.0:1782240076.770637:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782240076.770694:0:14077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758987776 00000100:00100000:1.0:1782240076.770700:0:14077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758987776 00000100:00100000:1.0:1782240076.770736:0:14077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782240076.770776:0:14077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc2aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1868813758987776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782240076.770829:0:14077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc2aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1868813758987776:12345-0@lo:400:kworker.0 Request processed in 84us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1782240076.770836:0:14077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1782240076.770871:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9bb5fc2a9880 x1868813758987776/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782240092 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782240076.770882:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fc2a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1868813758987776:0@lo:400:kworker.0 00000100:00100000:0.0:1782240076.773293:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fc2ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1868813758987648:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1782240076.773378:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1782240076.776026:0:14733:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000100:00100000:2.0:1782240076.783320:0:14078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758987648 00000100:00100000:2.0:1782240076.783333:0:14078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758987648 00000100:00100000:2.0:1782240076.783372:0:14078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782240076.783380:0:14078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f77a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3303:x1868813758987648:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1782240076.783407:0:14078:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 455 last 0 00000020:00000080:2.0:1782240076.783470:0:14078:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x8c5345f1c1ec5e1b 00000004:00100000:2.0:1782240076.783487:0:14078:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1782240076.783522:0:14078:0:(import.c:65:import_set_state_nolock()) ffff9bb5d1a17800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782240076.783614:0:14078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f77a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1868813758987648:12345-0@lo:38:llog_process_th.0 Request processed in 233us (10236us total) trans 0 rc 0/0 00000100:00100000:2.0:1782240076.783622:0:14078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1782240076.784394:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9bb5fc2ab800 x1868813758987648/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782240086 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782240076.784407:0:3303:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1782240076.784416:0:3303:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1782240076.784423:0:3303:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1782240076.784428:0:3303:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1782240076.784431:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9bb5c8d70000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1782240076.784437:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fc2ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1868813758987648:0@lo:38:llog_process_th.0 00000020:01000000:3.0:1782240076.785597:0:14710:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1782240076.785638:0:14710:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1782240076.785653:0:14710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e26000/0x8c5345f1c1ec5dff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec5e06 expref: -99 pid: 14710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240076.785664:0:14710:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e26000/0x8c5345f1c1ec5dff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec5e06 expref: -99 pid: 14710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1782240076.785708:0:14710:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1782240076.785713:0:14710:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1782240076.785714:0:14710:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782240076.785716:0:14710:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782240076.785717:0:14710:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782240076.785718:0:14710:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782240076.785719:0:14710:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1782240076.785720:0:14710:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782240076.785722:0:14710:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1782240076.785725:0:14710:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1782240076.785727:0:14710:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1782240076.785728:0:14710:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1782240076.785729:0:14710:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782240076.785730:0:14710:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782240076.785731:0:14710:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782240076.785732:0:14710:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782240076.785733:0:14710:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1782240076.785734:0:14710:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782240076.785735:0:14710:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1782240076.785782:0:14710:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1782240076.785798:0:14710:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f4895180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14710:1868813758987904:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1782240076.785852:0:14710:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782240076.785887:0:14710:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c2bfc240 going to sleep for 11 seconds 00000100:00100000:1.0:1782240076.785948:0:14068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758987904 00000100:00100000:1.0:1782240076.785955:0:14068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758987904 00000100:00100000:1.0:1782240076.786005:0:14068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1782240076.786013:0:14068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc0bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+16:14710:x1868813758987904:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1782240076.786036:0:14068:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1782240076.786048:0:14068:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1782240076.838199:0:14068:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1782240076.838252:0:14068:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1782240076.840350:0:14092:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1782240076.840359:0:14092:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1782240076.840381:0:14092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bb5f4436000/0x8c5345f1c1ec5e22 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240076.840558:0:14092:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bb5f7e26c00/0x8c5345f1c1ec5d8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c5345f1c1ec5d88 expref: 16 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240076.840568:0:14092:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bb5f4436000/0x8c5345f1c1ec5e22 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240076.840711:0:14092:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bb5f7e26c00/0x8c5345f1c1ec5d8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8c5345f1c1ec5d88 expref: 16 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240076.840726:0:14092:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bb5f7e26c00/0x8c5345f1c1ec5d8f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8c5345f1c1ec5d88 expref: 16 pid: 14070 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782240076.840741:0:14092:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f77a4380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14092:1868813758988032:0@lo:104: 00000100:00100000:0.0:1782240076.840829:0:14092:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782240076.840916:0:14092:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c84b8240 going to sleep for 11 seconds 00000100:00100000:2.0:1782240076.841179:0:14060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758988032 00000100:00100000:2.0:1782240076.841186:0:14060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758988032 00000100:00100000:2.0:1782240076.841246:0:14060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782240076.841256:0:14060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f77a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+3:14092:x1868813758988032:12345-0@lo:104: 00010000:00010000:2.0:1782240076.841268:0:14060:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e38e00/0x8c5345f1c1ec5d88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c5345f1c1ec5d8f expref: -99 pid: 14073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240076.841332:0:14060:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782240076.841337:0:14060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f77a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+3:14092:x1868813758988032:12345-0@lo:104: Request processed in 84us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1782240076.841345:0:14060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1782240076.841365:0:14064:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782240076.841382:0:14064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e38e00/0x8c5345f1c1ec5d88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c5345f1c1ec5d8f expref: -99 pid: 14073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240076.841390:0:14064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f7e38e00 already unused, calling callback (ffffffffc1d0cc20) 10000000:00010000:2.0:1782240076.841394:0:14064:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e38e00/0x8c5345f1c1ec5d88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8c5345f1c1ec5d8f expref: -99 pid: 14073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240076.841402:0:14064:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e38e00/0x8c5345f1c1ec5d88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8c5345f1c1ec5d8f expref: -99 pid: 14073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782240076.841410:0:14064:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e38e00/0x8c5345f1c1ec5d88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8c5345f1c1ec5d8f expref: -99 pid: 14073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782240076.841415:0:14064:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1782240076.841441:0:14064:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e38e00/0x8c5345f1c1ec5d88 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c5345f1c1ec5d8f expref: -99 pid: 14073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240076.841448:0:14064:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1782240076.841704:0:14092:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f77a4380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14092:1868813758988032:0@lo:104: 00010000:00010000:3.0:1782240076.841724:0:14092:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bb5f4436000/0x8c5345f1c1ec5e22 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240076.841798:0:14064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e38e00/0x8c5345f1c1ec5d88 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c5345f1c1ec5d8f expref: -99 pid: 14073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240076.841807:0:14064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e38e00/0x8c5345f1c1ec5d88 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c5345f1c1ec5d8f expref: -99 pid: 14073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240076.841823:0:14064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782240076.841825:0:14064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782240076.841826:0:14064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782240076.841841:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fbe0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:3307:1868813758988160:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782240076.841872:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782240076.841969:0:14063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758988160 00000100:00100000:3.0:1782240076.841974:0:14063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758988160 00010000:00010000:3.0:1782240076.841993:0:14063:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bb5f7e26c00/0x8c5345f1c1ec5d8f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c5345f1c1ec5d88 expref: 17 pid: 14070 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782240076.842020:0:14063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1782240076.842027:0:14063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fbe0b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+17:3307:x1868813758988160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782240076.842037:0:14063:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782240076.842050:0:14063:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bb5f7e26c00/0x8c5345f1c1ec5d8f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c5345f1c1ec5d88 expref: 17 pid: 14070 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240076.842059:0:14063:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bb5f7e26c00/0x8c5345f1c1ec5d8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8c5345f1c1ec5d88 expref: 17 pid: 14070 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240076.842073:0:14063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb5f7e26c00/0x8c5345f1c1ec5d8f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8c5345f1c1ec5d88 expref: 17 pid: 14070 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240076.842085:0:14063:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bb5f4436000/0x8c5345f1c1ec5e22 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240076.842093:0:14063:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb5f4436000/0x8c5345f1c1ec5e22 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1782240076.842106:0:14063:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004426508s 00010000:00010000:3.0:1782240076.842111:0:14063:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bb5f4436000/0x8c5345f1c1ec5e22 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240076.842118:0:14063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bb5f4436000/0x8c5345f1c1ec5e22 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240076.842124:0:14063:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bb5f4436000/0x8c5345f1c1ec5e22 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240076.842131:0:14063:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bb5f4436000/0x8c5345f1c1ec5e22 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240076.842136:0:14063:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f4436000 already unused, calling callback (ffffffffc1728ce0) 00010000:00010000:3.0:1782240076.842140:0:14063:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bb5f4436000/0x8c5345f1c1ec5e22 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240076.842157:0:14063:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bb5f4436000/0x8c5345f1c1ec5e22 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240076.842171:0:14063:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bb5f4436000/0x8c5345f1c1ec5e22 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240076.842180:0:14063:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782240076.842222:0:14063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fbe0b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+16:3307:x1868813758988160:12345-0@lo:103:ldlm_bl.0 Request processed in 195us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1782240076.842229:0:14063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1782240076.842249:0:14092:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bb5f4436000/0x8c5345f1c1ec5e22 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240076.842255:0:14092:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bb5f4436000/0x8c5345f1c1ec5e22 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240076.842261:0:14092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb5f4436000/0x8c5345f1c1ec5e22 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782240076.842385:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fbe0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:3307:1868813758988160:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782240076.849927:0:14068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc0bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+15:14710:x1868813758987904:12345-0@lo:253:mount.lustre.0 Request processed in 63906us (64065us total) trans 0 rc 0/0 00000100:00100000:1.0:1782240076.849943:0:14068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1782240076.850101:0:14710:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f4895180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14710:1868813758987904:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1782240076.850117:0:14710:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1782240076.850120:0:14710:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1782240076.850121:0:14710:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1782240076.850123:0:14710:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782240076.850124:0:14710:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782240076.850125:0:14710:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782240076.850127:0:14710:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782240076.850128:0:14710:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1782240076.850130:0:14710:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782240076.850131:0:14710:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1782240076.850165:0:14710:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1782240076.855120:0:14710:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1782240076.855323:0:14710:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1782240076.855567:0:14710:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1782240076.855855:0:14710:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1782240076.856141:0:14710:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1782240076.856377:0:14710:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1782240076.857553:0:14710:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1782240076.914454:0:14710:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1782240076.914470:0:14710:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1782240076.914500:0:14710:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1782240076.914561:0:14710:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.132@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1782240076.914575:0:14710:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1782240076.914603:0:14710:0:(super25.c:187:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1782240077.279729:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782240078.303178:0:14064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1782240078.567333:0:14073:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1782240078.567341:0:14073:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9bb5d204d000 from 7 10000000:01000000:0.0:1782240078.567347:0:14073:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1782240078.567396:0:14073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5f4436e00/0x8c5345f1c1ec5e29 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240078.567408:0:14073:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: ffff9bb5f4436e00/0x8c5345f1c1ec5e29 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240078.567420:0:14073:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff9bb5f4436e00/0x8c5345f1c1ec5e29 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782240078.567524:0:14073:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f77a4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14073:1868813758988288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782240078.567595:0:14073:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782240078.567647:0:14073:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5f7b47e40 going to sleep for 11 seconds 00000100:00100000:2.0:1782240078.567832:0:14071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758988288 00000100:00100000:2.0:1782240078.567840:0:14071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758988288 00000100:00100000:2.0:1782240078.567890:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1782240078.567900:0:14071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc0be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+15:14073:x1868813758988288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782240078.567914:0:14071:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782240078.567927:0:14071:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb5ee29e000/0x8c5345f1c1ec5e30 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c5345f1c1ec5e29 expref: -99 pid: 14071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240078.567951:0:14071:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb5ee29e000/0x8c5345f1c1ec5e30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c5345f1c1ec5e29 expref: 16 pid: 14071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240078.567962:0:14071:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb5ee29e000/0x8c5345f1c1ec5e30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c5345f1c1ec5e29 expref: 16 pid: 14071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240078.567971:0:14071:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5ee29e000, rc 0) 00000100:00100000:2.0:1782240078.568021:0:14071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc0be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+16:14073:x1868813758988288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1782240078.568027:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1782240078.568286:0:14073:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f77a4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14073:1868813758988288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782240078.568301:0:14073:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff9bb5f4436e00/0x8c5345f1c1ec5e29 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec5e30 expref: -99 pid: 14073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240078.568310:0:14073:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff9bb5f4436e00/0x8c5345f1c1ec5e29 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c5345f1c1ec5e30 expref: -99 pid: 14073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782240078.568360:0:14073:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f77a4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14073:1868813758988416:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1782240078.568392:0:14073:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782240078.568424:0:14073:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5f7b47e40 going to sleep for 11 seconds 00000100:00100000:3.0:1782240078.569376:0:14068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758988416 00000100:00100000:3.0:1782240078.569385:0:14068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758988416 00000100:00100000:3.0:1782240078.569436:0:14068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1782240078.569445:0:14068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ee8ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+16:14073:x1868813758988416:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1782240078.569550:0:14068:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1782240078.569570:0:14068:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1782240078.569573:0:14068:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1782240078.569690:0:14068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ee8ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+16:14073:x1868813758988416:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 245us (1297us total) trans 0 rc 0/0 00000100:00100000:3.0:1782240078.569698:0:14068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1782240078.569953:0:14073:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f77a4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14073:1868813758988416:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1782240078.570017:0:14073:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1782240078.570027:0:14073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5f4436e00/0x8c5345f1c1ec5e29 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec5e30 expref: -99 pid: 14073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240078.570038:0:14073:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff9bb5f4436e00/0x8c5345f1c1ec5e29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec5e30 expref: -99 pid: 14073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240079.328039:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782240080.357655:0:14064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782240081.378663:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1782240082.207024:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782240082.207031:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1782240082.207034:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782240082.207036:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1782240082.207087:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fbe0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:3304:1868813758988544:0@lo:400:kworker.0 00000100:00100000:2.0:1782240082.207175:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782240082.207227:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782240082.207233:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fbe09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1868813758988672:0@lo:400:kworker.0 00000100:00100000:2.0:1782240082.207259:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782240082.207294:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fbe08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1868813758988800:0@lo:400:kworker.0 00000100:00100000:2.0:1782240082.207318:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782240082.207350:0:14070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758988544 00000100:00100000:2.0:1782240082.207356:0:14070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758988544 00000100:00100000:2.0:1782240082.207396:0:14070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1782240082.207404:0:14070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ee8ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+16:3304:x1868813758988544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782240082.207455:0:14070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ee8ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+16:3304:x1868813758988544:12345-0@lo:400:kworker.0 Request processed in 52us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1782240082.207463:0:14070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1782240082.207495:0:14076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758988672 00000100:00100000:2.0:1782240082.207499:0:14076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758988672 00000100:00100000:2.0:1782240082.207520:0:14076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758988800 00000100:00100000:2.0:1782240082.207522:0:14076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758988800 00000100:00100000:2.0:1782240082.207544:0:14076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782240082.207558:0:14076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fbe0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1868813758988672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782240082.207592:0:14076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fbe0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1868813758988672:12345-0@lo:400:kworker.0 Request processed in 35us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1782240082.207598:0:14076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782240082.207609:0:14076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1782240082.207615:0:14076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fbe09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1868813758988800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782240082.207645:0:14076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fbe09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1868813758988800:12345-0@lo:400:kworker.0 Request processed in 30us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1782240082.207651:0:14076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1782240082.207668:0:14072:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1782240082.207689:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bb5fbe08e00 x1868813758988800/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782240098 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782240082.207702:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fbe08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1868813758988800:0@lo:400:kworker.0 00010000:00080000:2.0:1782240082.207724:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bb5fbe09c00 x1868813758988672/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782240098 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782240082.207732:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fbe09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1868813758988672:0@lo:400:kworker.0 00000100:00100000:2.0:1782240082.207739:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fbe0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:3304:1868813758988544:0@lo:400:kworker.0 00010000:00010000:1.0:1782240082.402645:0:14064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782240083.424213:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782240083.465560:0:15078:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg332-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1782240084.447997:0:14064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1782240085.026780:0:14110:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1782240085.475316:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782240086.495435:0:14064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1782240087.328323:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782240087.328330:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1782240087.328334:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782240087.328338:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1782240087.328416:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782240087.328448:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f4895180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:3306:1868813758988928:0@lo:400:kworker.0 00000100:00100000:1.0:1782240087.328456:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f4896a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1868813758989056:0@lo:400:kworker.0 00000100:00100000:1.0:1782240087.333797:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782240087.333873:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782240087.333886:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f4895c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1868813758989184:0@lo:400:kworker.0 00000100:00100000:1.0:1782240087.333928:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782240087.333976:0:14078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758989056 00000100:00100000:1.0:1782240087.333983:0:14078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758989056 00000100:00100000:1.0:1782240087.334022:0:14078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758989184 00000100:00100000:1.0:1782240087.334025:0:14078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758989184 00000100:00100000:1.0:1782240087.334051:0:14078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782240087.334059:0:14078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc2a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1868813758989056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782240087.334111:0:14078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc2a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1868813758989056:12345-0@lo:400:kworker.0 Request processed in 52us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1782240087.334131:0:14078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782240087.334172:0:14078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1782240087.334178:0:14078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc2ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1868813758989184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782240087.334209:0:14078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc2ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1868813758989184:12345-0@lo:400:kworker.0 Request processed in 31us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1782240087.334214:0:14078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1782240087.334413:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782240087.334468:0:14071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758988928 00000100:00100000:3.0:1782240087.334473:0:14071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758988928 00000100:00100000:3.0:1782240087.334506:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1782240087.334513:0:14071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ee8ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+16:3306:x1868813758988928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782240087.334563:0:14071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ee8ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+16:3306:x1868813758988928:12345-0@lo:400:kworker.0 Request processed in 51us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1782240087.334570:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1782240087.334616:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f4895180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:3306:1868813758988928:0@lo:400:kworker.0 00000100:00080000:0.0:1782240087.335549:0:14072:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1782240087.335898:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bb5f4895c00 x1868813758989184/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782240103 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782240087.335913:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f4895c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1868813758989184:0@lo:400:kworker.0 00010000:00080000:1.0:1782240087.335927:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bb5f4896a00 x1868813758989056/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782240103 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782240087.335935:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f4896a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1868813758989056:0@lo:400:kworker.0 00010000:00010000:1.0:1782240087.520175:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782240088.548021:0:14064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782240089.567003:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782240090.015260:0:3303:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782240074/real 1782240074] req@ffff9bb5fbe0a300 x1868813758984576/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782240089 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782240090.015298:0:3303:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9bb5fbe0a300 x1868813758984576/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782240089 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782240090.015308:0:3303:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782240074/real 1782240074] req@ffff9bb5fbe08000 x1868813758984704/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782240089 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782240090.015319:0:3303:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9bb5fbe08000 x1868813758984704/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782240089 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1782240090.015341:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9bb601914000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1782240090.015374:0:3303:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1782240090.015378:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fbe0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1868813758984576:0@lo:8:kworker.0 00000100:00080000:1.0:1782240090.015395:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9bb5fbba2800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1782240090.015401:0:3303:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1782240090.015405:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fbe08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1868813758984704:0@lo:8:kworker.0 00000100:00080000:3.0:1782240090.015918:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782240090.015924:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1782240090.015928:0:36:0:(import.c:65:import_set_state_nolock()) ffff9bb601914000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1782240090.015933:0:36:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 453 00000100:00080000:3.0:1782240090.015940:0:36:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1782240090.015948:0:36:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9bb601914000 using connection 192.168.203.132@tcp/0@lo 00000100:00100000:3.0:1782240090.015976:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bb5f4894000 x1868813758989440/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1782240090.015995:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782240090.016001:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00100000:0.0:1782240090.016003:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f4895180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:3306:1868813758989312:0@lo:400:kworker.0 00000100:00080000:3.0:1782240090.016004:0:36:0:(import.c:65:import_set_state_nolock()) ffff9bb5fbba2800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1782240090.016012:0:36:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 453 00000100:00080000:3.0:1782240090.016021:0:36:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1782240090.016028:0:36:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9bb5fbba2800 using connection 192.168.203.132@tcp/0@lo 00000100:00100000:3.0:1782240090.016044:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bb5f4897b80 x1868813758989568/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1782240090.016116:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782240090.016124:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f4894700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1868813758989824:0@lo:400:kworker.0 00000100:00100000:3.0:1782240090.016204:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782240090.016208:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782240090.016238:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f4894380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1868813758989696:0@lo:400:kworker.0 00000100:00100000:3.0:1782240090.016292:0:14078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758989824 00000100:00100000:0.0:1782240090.016295:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782240090.016306:0:14078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758989824 00000100:00100000:0.0:1782240090.016374:0:14068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758989312 00000100:00100000:3.0:1782240090.016390:0:14078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758989696 00000100:00100000:0.0:1782240090.016392:0:14068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758989312 00000100:00100000:3.0:1782240090.016397:0:14078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758989696 00000100:00100000:3.0:1782240090.016429:0:14078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1782240090.016466:0:14068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1782240090.016478:0:14068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ee8eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+16:3306:x1868813758989312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782240090.016528:0:14068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ee8eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+16:3306:x1868813758989312:12345-0@lo:400:kworker.0 Request processed in 53us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1782240090.016536:0:14068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1782240090.016579:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f4895180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:3306:1868813758989312:0@lo:400:kworker.0 00000100:00100000:3.0:1782240090.017158:0:14078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f4896a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1868813758989824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782240090.017246:0:14078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f4896a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1868813758989824:12345-0@lo:400:kworker.0 Request processed in 98us (1042us total) trans 0 rc 0/0 00000100:00100000:3.0:1782240090.017254:0:14078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1782240090.017279:0:14078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1782240090.017286:0:14078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f77a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1868813758989696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782240090.017339:0:14078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f77a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1868813758989696:12345-0@lo:400:kworker.0 Request processed in 53us (1045us total) trans 0 rc 0/0 00000100:00100000:3.0:1782240090.017350:0:14078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1782240090.017352:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bb5f4894700 x1868813758989824/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782240106 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782240090.017369:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f4894700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1868813758989824:0@lo:400:kworker.0 00000100:00080000:3.0:1782240090.017377:0:14072:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782240090.017409:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f4894000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1868813758989440:0@lo:8:kworker.0 00000100:00100000:3.0:1782240090.017459:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782240090.017496:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f4897b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1868813758989568:0@lo:8:kworker.0 00000100:00100000:3.0:1782240090.017519:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1782240090.017573:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bb5f4894380 x1868813758989696/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782240106 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782240090.017578:0:14712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758989440 00000100:00100000:0.0:1782240090.017590:0:14712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758989440 00000100:00100000:3.0:1782240090.017595:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f4894380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1868813758989696:0@lo:400:kworker.0 00000100:00100000:0.0:1782240090.017640:0:14712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758989568 00000100:00100000:0.0:1782240090.017647:0:14712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758989568 00000100:00100000:3.0:1782240090.017666:0:14714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782240090.017674:0:14714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f4895c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3303:x1868813758989440:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1782240090.018585:0:14714:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 469 last 0 00000020:00000080:3.0:1782240090.018627:0:14714:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8c5345f1c1ec5e37 00002000:00100000:3.0:1782240090.018655:0:14714:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9bb601668000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113653 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1782240090.018660:0:14714:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1782240090.018664:0:14714:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1782240090.019136:0:14714:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1782240090.019171:0:14714:0:(import.c:65:import_set_state_nolock()) ffff9bb60166e800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782240090.019270:0:14714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f4895c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3303:x1868813758989440:12345-0@lo:8:kworker.0 Request processed in 1594us (1810us total) trans 0 rc 0/0 00000100:00100000:3.0:1782240090.019280:0:14714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782240090.019315:0:14714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782240090.019321:0:14714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f4897800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3303:x1868813758989568:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1782240090.019336:0:14714:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1782240090.019373:0:14714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f4897800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3303:x1868813758989568:12345-0@lo:8:kworker.0 Request processed in 50us (1852us total) trans 0 rc -19/-19 00000100:00100000:3.0:1782240090.019379:0:14714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1782240090.019395:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bb5f4894000 x1868813758989440/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1782240110 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782240090.019418:0:3303:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1782240090.019428:0:3303:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1782240090.019438:0:3303:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1782240090.019445:0:3303:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1782240090.019449:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9bb601914000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1782240090.019474:0:3303:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1782240090.019495:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f4894000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1868813758989440:0@lo:8:kworker.0 00000100:00080000:0.0:1782240090.019530:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9bb5fbba2800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1782240090.019535:0:3303:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1782240090.019538:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f4897b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1868813758989568:0@lo:8:kworker.0 00000100:00100000:0.0:1782240090.022197:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f4894380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813758989952:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782240090.022284:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782240090.022827:0:14715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758989952 00000100:00100000:1.0:1782240090.022838:0:14715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758989952 00000100:00100000:1.0:1782240090.022925:0:14715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782240090.022936:0:14715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f77a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1868813758989952:12345-0@lo:13:osp-pre-0-0.0 00000004:00080000:3.0:1782240090.022972:0:14099:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00002000:00000024:1.0:1782240090.022984:0:14715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782240090.023001:0:14099:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f4897100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14099:1868813758990080:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1782240090.023720:0:14099:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782240090.023918:0:14099:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c8460000 going to sleep for 11 seconds 00000004:00080000:3.0:1782240090.023944:0:14098:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1782240090.024592:0:14098:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 469096843293ns, next at 0ns, rc = 0 00000100:00080000:3.0:1782240090.024632:0:14072:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782240090.025775:0:14715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f77a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1868813758989952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2832us (3482us total) trans 0 rc 0/0 00000100:00100000:1.0:1782240090.025793:0:14715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1782240090.025887:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bb5f4894380 x1868813758989952/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782240106 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782240090.025915:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f4894380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813758989952:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782240090.026944:0:14712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758990080 00000100:00100000:0.0:1782240090.026958:0:14712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758990080 00000100:00100000:0.0:1782240090.027308:0:14712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1782240090.027320:0:14712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f4895880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14099:x1868813758990080:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1782240090.032035:0:14712:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1782240090.032053:0:14712:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:0.0:1782240090.032061:0:14712:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00002000:00010000:0.0:1782240090.046599:0:14712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782240090.046616:0:14712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000060d4660/0x8c5345f1c1ec5e3e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.046636:0:14712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=469s v=(0 0) 00010000:00010000:0.0:1782240090.046641:0:14712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782240090.046648:0:14712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000060d4660/0x8c5345f1c1ec5e3e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.046668:0:14712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000060d4660/0x8c5345f1c1ec5e3e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.046680:0:14712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000060d4660/0x8c5345f1c1ec5e3e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.046697:0:14712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000060d4660/0x8c5345f1c1ec5e3e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.046723:0:14712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782240090.046743:0:14064:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782240090.046779:0:14064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000060d4660/0x8c5345f1c1ec5e3e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.047542:0:14064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f4437e00 already unused, calling callback (ffffffffc1728ce0) 00010000:00010000:0.0:1782240090.047548:0:14064:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000060d4660/0x8c5345f1c1ec5e3e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.047561:0:14064:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000060d4660/0x8c5345f1c1ec5e3e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.047845:0:14064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000060d4660/0x8c5345f1c1ec5e3e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.047856:0:14064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000060d4660/0x8c5345f1c1ec5e3e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.047933:0:14064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782240090.047935:0:14064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782240090.047937:0:14064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782240090.050079:0:14712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782240090.050111:0:14712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f143d23/0x8c5345f1c1ec5e45 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.050130:0:14712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=469s v=(0 0) 00010000:00010000:0.0:1782240090.050135:0:14712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782240090.050141:0:14712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f143d23/0x8c5345f1c1ec5e45 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.050156:0:14712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004f143d23/0x8c5345f1c1ec5e45 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.050166:0:14712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f143d23/0x8c5345f1c1ec5e45 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.050173:0:14712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004f143d23/0x8c5345f1c1ec5e45 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.050201:0:14712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782240090.051540:0:14065:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782240090.051554:0:14065:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004f143d23/0x8c5345f1c1ec5e45 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240090.051569:0:14065:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f4436400 already unused, calling callback (ffffffffc1728ce0) 00010000:00010000:1.0:1782240090.051574:0:14065:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004f143d23/0x8c5345f1c1ec5e45 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240090.051584:0:14065:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004f143d23/0x8c5345f1c1ec5e45 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240090.051625:0:14065:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004f143d23/0x8c5345f1c1ec5e45 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240090.051633:0:14065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004f143d23/0x8c5345f1c1ec5e45 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240090.051670:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782240090.051672:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782240090.051674:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782240090.056552:0:14712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782240090.056573:0:14712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f9c7d81/0x8c5345f1c1ec5e4c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.056597:0:14712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=469s v=(0 0) 00010000:00010000:0.0:1782240090.056602:0:14712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782240090.056610:0:14712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f9c7d81/0x8c5345f1c1ec5e4c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.056626:0:14712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004f9c7d81/0x8c5345f1c1ec5e4c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.056646:0:14712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f9c7d81/0x8c5345f1c1ec5e4c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.056655:0:14712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004f9c7d81/0x8c5345f1c1ec5e4c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.056680:0:14712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782240090.056854:0:14064:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782240090.056864:0:14064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004f9c7d81/0x8c5345f1c1ec5e4c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240090.056876:0:14064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f4436000 already unused, calling callback (ffffffffc1728ce0) 00010000:00010000:3.0:1782240090.056889:0:14064:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004f9c7d81/0x8c5345f1c1ec5e4c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240090.056901:0:14064:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004f9c7d81/0x8c5345f1c1ec5e4c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240090.056932:0:14064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004f9c7d81/0x8c5345f1c1ec5e4c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240090.056941:0:14064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004f9c7d81/0x8c5345f1c1ec5e4c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240090.056972:0:14064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782240090.056976:0:14064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782240090.056978:0:14064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782240090.057661:0:14712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782240090.057671:0:14712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8cde04d/0x8c5345f1c1ec5e53 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.057684:0:14712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=469s v=(0 0) 00010000:00010000:0.0:1782240090.057688:0:14712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782240090.057693:0:14712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f8cde04d/0x8c5345f1c1ec5e53 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.057706:0:14712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f8cde04d/0x8c5345f1c1ec5e53 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.057715:0:14712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8cde04d/0x8c5345f1c1ec5e53 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.057723:0:14712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f8cde04d/0x8c5345f1c1ec5e53 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.057856:0:14712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782240090.057868:0:14065:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782240090.057874:0:14065:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f8cde04d/0x8c5345f1c1ec5e53 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.057883:0:14065:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f4436600 already unused, calling callback (ffffffffc1728ce0) 00010000:00010000:0.0:1782240090.057887:0:14065:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8cde04d/0x8c5345f1c1ec5e53 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.057896:0:14065:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8cde04d/0x8c5345f1c1ec5e53 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.057913:0:14065:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f8cde04d/0x8c5345f1c1ec5e53 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.057921:0:14065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f8cde04d/0x8c5345f1c1ec5e53 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.057937:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782240090.057939:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782240090.057940:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782240090.058991:0:14712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782240090.059003:0:14712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008482d4e5/0x8c5345f1c1ec5e5a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.059020:0:14712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=469s v=(0 0) 00010000:00010000:0.0:1782240090.059032:0:14712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782240090.059039:0:14712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008482d4e5/0x8c5345f1c1ec5e5a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.059053:0:14712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008482d4e5/0x8c5345f1c1ec5e5a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.059064:0:14712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008482d4e5/0x8c5345f1c1ec5e5a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.059072:0:14712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008482d4e5/0x8c5345f1c1ec5e5a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.059092:0:14712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782240090.059118:0:14064:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782240090.059125:0:14064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008482d4e5/0x8c5345f1c1ec5e5a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.059133:0:14064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f4437000 already unused, calling callback (ffffffffc1728ce0) 00010000:00010000:0.0:1782240090.059138:0:14064:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008482d4e5/0x8c5345f1c1ec5e5a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.059145:0:14064:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008482d4e5/0x8c5345f1c1ec5e5a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.059161:0:14064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008482d4e5/0x8c5345f1c1ec5e5a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.059182:0:14064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008482d4e5/0x8c5345f1c1ec5e5a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.059203:0:14064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782240090.059206:0:14064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782240090.059208:0:14064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782240090.060023:0:14712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782240090.060032:0:14712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048ace9aa/0x8c5345f1c1ec5e61 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.060200:0:14712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=469s v=(0 0) 00010000:00010000:0.0:1782240090.060204:0:14712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782240090.060210:0:14712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000048ace9aa/0x8c5345f1c1ec5e61 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.060222:0:14712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000048ace9aa/0x8c5345f1c1ec5e61 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.060232:0:14712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048ace9aa/0x8c5345f1c1ec5e61 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.060240:0:14712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000048ace9aa/0x8c5345f1c1ec5e61 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.060260:0:14712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782240090.060272:0:14065:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782240090.060285:0:14065:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000048ace9aa/0x8c5345f1c1ec5e61 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.060292:0:14065:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f4437200 already unused, calling callback (ffffffffc1728ce0) 00010000:00010000:0.0:1782240090.060296:0:14065:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000048ace9aa/0x8c5345f1c1ec5e61 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.060304:0:14065:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000048ace9aa/0x8c5345f1c1ec5e61 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.060444:0:14065:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000048ace9aa/0x8c5345f1c1ec5e61 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.060453:0:14065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000048ace9aa/0x8c5345f1c1ec5e61 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.060472:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782240090.060474:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782240090.060476:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782240090.061308:0:14712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782240090.061452:0:14712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005042bc30/0x8c5345f1c1ec5e68 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.061468:0:14712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=469s v=(0 0) 00010000:00010000:0.0:1782240090.061472:0:14712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782240090.061478:0:14712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005042bc30/0x8c5345f1c1ec5e68 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.061505:0:14712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005042bc30/0x8c5345f1c1ec5e68 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.061516:0:14712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005042bc30/0x8c5345f1c1ec5e68 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.061526:0:14712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005042bc30/0x8c5345f1c1ec5e68 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.061546:0:14712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782240090.061556:0:14064:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782240090.061562:0:14064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005042bc30/0x8c5345f1c1ec5e68 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.061570:0:14064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f4437800 already unused, calling callback (ffffffffc1728ce0) 00010000:00010000:0.0:1782240090.061575:0:14064:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005042bc30/0x8c5345f1c1ec5e68 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.061583:0:14064:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005042bc30/0x8c5345f1c1ec5e68 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.061598:0:14064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005042bc30/0x8c5345f1c1ec5e68 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.061606:0:14064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005042bc30/0x8c5345f1c1ec5e68 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.061630:0:14064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782240090.061632:0:14064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782240090.061634:0:14064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782240090.062608:0:14712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782240090.062617:0:14712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ded7ee2/0x8c5345f1c1ec5e6f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.062631:0:14712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=469s v=(0 0) 00010000:00010000:0.0:1782240090.062636:0:14712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782240090.062642:0:14712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ded7ee2/0x8c5345f1c1ec5e6f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.062654:0:14712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ded7ee2/0x8c5345f1c1ec5e6f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.062664:0:14712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ded7ee2/0x8c5345f1c1ec5e6f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.062672:0:14712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000ded7ee2/0x8c5345f1c1ec5e6f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.062696:0:14712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782240090.062945:0:14065:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782240090.062955:0:14065:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000ded7ee2/0x8c5345f1c1ec5e6f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240090.062966:0:14065:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f4436a00 already unused, calling callback (ffffffffc1728ce0) 00010000:00010000:3.0:1782240090.062971:0:14065:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000ded7ee2/0x8c5345f1c1ec5e6f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240090.062981:0:14065:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000ded7ee2/0x8c5345f1c1ec5e6f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240090.062999:0:14065:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000ded7ee2/0x8c5345f1c1ec5e6f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240090.063017:0:14065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ded7ee2/0x8c5345f1c1ec5e6f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240090.063041:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782240090.063044:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782240090.063047:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782240090.066709:0:14712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782240090.066730:0:14712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000060d4660/0x8c5345f1c1ec5e76 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.066783:0:14712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=469s v=(0 0) 00010000:00010000:0.0:1782240090.066788:0:14712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782240090.066795:0:14712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000060d4660/0x8c5345f1c1ec5e76 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.066813:0:14712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000060d4660/0x8c5345f1c1ec5e76 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.066827:0:14712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000060d4660/0x8c5345f1c1ec5e76 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.066837:0:14712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000060d4660/0x8c5345f1c1ec5e76 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.066868:0:14712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782240090.066892:0:14064:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782240090.066899:0:14064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000060d4660/0x8c5345f1c1ec5e76 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.066907:0:14064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f4437e00 already unused, calling callback (ffffffffc1728ce0) 00010000:00010000:0.0:1782240090.066912:0:14064:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000060d4660/0x8c5345f1c1ec5e76 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.066922:0:14064:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000060d4660/0x8c5345f1c1ec5e76 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.066956:0:14064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000060d4660/0x8c5345f1c1ec5e76 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.066964:0:14064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000060d4660/0x8c5345f1c1ec5e76 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.066988:0:14064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782240090.066990:0:14064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782240090.066992:0:14064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782240090.070772:0:14712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782240090.070791:0:14712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2ee87a6/0x8c5345f1c1ec5e7d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.070814:0:14712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=469s v=(0 0) 00010000:00010000:0.0:1782240090.070820:0:14712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782240090.070828:0:14712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2ee87a6/0x8c5345f1c1ec5e7d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.070844:0:14712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2ee87a6/0x8c5345f1c1ec5e7d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.070856:0:14712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2ee87a6/0x8c5345f1c1ec5e7d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.070864:0:14712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2ee87a6/0x8c5345f1c1ec5e7d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.070916:0:14712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782240090.070941:0:14065:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782240090.070948:0:14065:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2ee87a6/0x8c5345f1c1ec5e7d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.070957:0:14065:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f4437600 already unused, calling callback (ffffffffc1728ce0) 00010000:00010000:0.0:1782240090.070962:0:14065:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2ee87a6/0x8c5345f1c1ec5e7d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.070972:0:14065:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2ee87a6/0x8c5345f1c1ec5e7d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.070995:0:14065:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2ee87a6/0x8c5345f1c1ec5e7d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.071004:0:14065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2ee87a6/0x8c5345f1c1ec5e7d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.071034:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782240090.071036:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782240090.071038:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782240090.073734:0:14712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782240090.075464:0:14712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2533037/0x8c5345f1c1ec5e84 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.075553:0:14712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=469s v=(0 0) 00010000:00010000:0.0:1782240090.075566:0:14712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782240090.075577:0:14712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f2533037/0x8c5345f1c1ec5e84 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.075598:0:14712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f2533037/0x8c5345f1c1ec5e84 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.075611:0:14712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2533037/0x8c5345f1c1ec5e84 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.075619:0:14712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f2533037/0x8c5345f1c1ec5e84 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.075641:0:14712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782240090.075653:0:14064:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782240090.075663:0:14064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f2533037/0x8c5345f1c1ec5e84 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240090.075674:0:14064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f4436800 already unused, calling callback (ffffffffc1728ce0) 00010000:00010000:2.0:1782240090.075679:0:14064:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2533037/0x8c5345f1c1ec5e84 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240090.075702:0:14064:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2533037/0x8c5345f1c1ec5e84 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240090.075728:0:14064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f2533037/0x8c5345f1c1ec5e84 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240090.075737:0:14064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f2533037/0x8c5345f1c1ec5e84 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240090.075795:0:14064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782240090.075797:0:14064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782240090.075799:0:14064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782240090.078772:0:14712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782240090.078794:0:14712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005042bc30/0x8c5345f1c1ec5e8b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.078815:0:14712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=469s v=(0 0) 00010000:00010000:0.0:1782240090.078820:0:14712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782240090.078827:0:14712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005042bc30/0x8c5345f1c1ec5e8b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.078842:0:14712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005042bc30/0x8c5345f1c1ec5e8b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.078854:0:14712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005042bc30/0x8c5345f1c1ec5e8b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.078872:0:14712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005042bc30/0x8c5345f1c1ec5e8b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.078896:0:14712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782240090.078943:0:14065:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782240090.078954:0:14065:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005042bc30/0x8c5345f1c1ec5e8b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240090.078966:0:14065:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f4437800 already unused, calling callback (ffffffffc1728ce0) 00010000:00010000:2.0:1782240090.078972:0:14065:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005042bc30/0x8c5345f1c1ec5e8b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240090.078985:0:14065:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005042bc30/0x8c5345f1c1ec5e8b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240090.079008:0:14065:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005042bc30/0x8c5345f1c1ec5e8b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240090.079031:0:14065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005042bc30/0x8c5345f1c1ec5e8b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240090.079055:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782240090.079058:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782240090.079060:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782240090.079501:0:14712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782240090.079508:0:14712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048ace9aa/0x8c5345f1c1ec5e92 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.079520:0:14712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=469s v=(0 0) 00010000:00010000:0.0:1782240090.079523:0:14712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782240090.079532:0:14712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000048ace9aa/0x8c5345f1c1ec5e92 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.079541:0:14712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000048ace9aa/0x8c5345f1c1ec5e92 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.079550:0:14712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048ace9aa/0x8c5345f1c1ec5e92 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.079557:0:14712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000048ace9aa/0x8c5345f1c1ec5e92 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.079625:0:14712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1782240090.080137:0:14712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782240090.080145:0:14712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008482d4e5/0x8c5345f1c1ec5e99 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.080161:0:14712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=469s v=(0 0) 00010000:00010000:0.0:1782240090.080165:0:14712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782240090.080170:0:14712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008482d4e5/0x8c5345f1c1ec5e99 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.080181:0:14712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008482d4e5/0x8c5345f1c1ec5e99 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.080189:0:14712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008482d4e5/0x8c5345f1c1ec5e99 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.080197:0:14712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008482d4e5/0x8c5345f1c1ec5e99 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240090.081566:0:14064:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782240090.081580:0:14064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000048ace9aa/0x8c5345f1c1ec5e92 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240090.081596:0:14064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f4437200 already unused, calling callback (ffffffffc1728ce0) 00010000:00010000:2.0:1782240090.081601:0:14064:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000048ace9aa/0x8c5345f1c1ec5e92 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240090.081612:0:14064:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000048ace9aa/0x8c5345f1c1ec5e92 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240090.081638:0:14064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000048ace9aa/0x8c5345f1c1ec5e92 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240090.081646:0:14064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000048ace9aa/0x8c5345f1c1ec5e92 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240090.081671:0:14064:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782240090.081675:0:14064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008482d4e5/0x8c5345f1c1ec5e99 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240090.081691:0:14064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f4437000 already unused, calling callback (ffffffffc1728ce0) 00010000:00010000:2.0:1782240090.081695:0:14064:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008482d4e5/0x8c5345f1c1ec5e99 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240090.081703:0:14064:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008482d4e5/0x8c5345f1c1ec5e99 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240090.081715:0:14064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008482d4e5/0x8c5345f1c1ec5e99 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240090.081723:0:14064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782240090.081724:0:14064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782240090.081726:0:14064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782240090.082773:0:14712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1782240090.082911:0:14712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008482d4e5/0x8c5345f1c1ec5e99 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240090.082923:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782240090.086108:0:14712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782240090.086128:0:14712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8cde04d/0x8c5345f1c1ec5ea0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.086149:0:14712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=469s v=(0 0) 00010000:00010000:0.0:1782240090.086154:0:14712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782240090.086162:0:14712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f8cde04d/0x8c5345f1c1ec5ea0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.086191:0:14712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f8cde04d/0x8c5345f1c1ec5ea0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.086209:0:14712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8cde04d/0x8c5345f1c1ec5ea0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.086219:0:14712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f8cde04d/0x8c5345f1c1ec5ea0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.087513:0:14712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1782240090.088589:0:14712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782240090.088602:0:14712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d38cb6d/0x8c5345f1c1ec5ea7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.088623:0:14712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=469s v=(0 0) 00010000:00010000:0.0:1782240090.088628:0:14712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782240090.088635:0:14712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d38cb6d/0x8c5345f1c1ec5ea7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.088650:0:14712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001d38cb6d/0x8c5345f1c1ec5ea7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.088662:0:14712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d38cb6d/0x8c5345f1c1ec5ea7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.088682:0:14712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001d38cb6d/0x8c5345f1c1ec5ea7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240090.090530:0:14064:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782240090.090549:0:14064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f8cde04d/0x8c5345f1c1ec5ea0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240090.090566:0:14064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f4436600 already unused, calling callback (ffffffffc1728ce0) 00010000:00010000:2.0:1782240090.090572:0:14064:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8cde04d/0x8c5345f1c1ec5ea0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240090.090584:0:14064:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8cde04d/0x8c5345f1c1ec5ea0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240090.090614:0:14064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f8cde04d/0x8c5345f1c1ec5ea0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240090.090645:0:14064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f8cde04d/0x8c5345f1c1ec5ea0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240090.090719:0:14064:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782240090.090726:0:14064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001d38cb6d/0x8c5345f1c1ec5ea7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240090.090735:0:14064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f4437400 already unused, calling callback (ffffffffc1728ce0) 00010000:00010000:3.0:1782240090.090739:0:14064:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001d38cb6d/0x8c5345f1c1ec5ea7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.090772:0:14712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1782240090.090775:0:14064:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001d38cb6d/0x8c5345f1c1ec5ea7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240090.090890:0:14064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001d38cb6d/0x8c5345f1c1ec5ea7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240090.090899:0:14064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001d38cb6d/0x8c5345f1c1ec5ea7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240090.090916:0:14064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782240090.090917:0:14064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782240090.090924:0:14064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782240090.091410:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782240090.091683:0:14712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782240090.091691:0:14712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e0745943/0x8c5345f1c1ec5eae lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.091706:0:14712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=469s v=(0 0) 00010000:00010000:0.0:1782240090.091712:0:14712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782240090.091720:0:14712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e0745943/0x8c5345f1c1ec5eae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.091734:0:14712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e0745943/0x8c5345f1c1ec5eae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.091743:0:14712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e0745943/0x8c5345f1c1ec5eae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782240090.091977:0:5812:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:0.0:1782240090.092035:0:14712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e0745943/0x8c5345f1c1ec5eae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.092089:0:14712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1782240090.092547:0:14712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782240090.092558:0:14712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b25db6fd/0x8c5345f1c1ec5eb5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.092579:0:14712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=469s v=(0 0) 00010000:00010000:0.0:1782240090.092583:0:14712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782240090.092588:0:14712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b25db6fd/0x8c5345f1c1ec5eb5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.092600:0:14712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b25db6fd/0x8c5345f1c1ec5eb5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.092608:0:14712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b25db6fd/0x8c5345f1c1ec5eb5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.092616:0:14712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b25db6fd/0x8c5345f1c1ec5eb5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240090.092782:0:14064:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782240090.092792:0:14064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e0745943/0x8c5345f1c1ec5eae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240090.092802:0:14064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f4437c00 already unused, calling callback (ffffffffc1728ce0) 00010000:00010000:2.0:1782240090.092806:0:14064:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0745943/0x8c5345f1c1ec5eae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240090.092814:0:14064:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0745943/0x8c5345f1c1ec5eae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240090.092833:0:14064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e0745943/0x8c5345f1c1ec5eae lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240090.092841:0:14064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e0745943/0x8c5345f1c1ec5eae lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240090.092862:0:14064:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782240090.092866:0:14064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b25db6fd/0x8c5345f1c1ec5eb5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240090.092882:0:14064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f4436200 already unused, calling callback (ffffffffc1728ce0) 00010000:00010000:2.0:1782240090.092885:0:14064:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b25db6fd/0x8c5345f1c1ec5eb5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240090.092891:0:14064:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b25db6fd/0x8c5345f1c1ec5eb5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240090.092900:0:14064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b25db6fd/0x8c5345f1c1ec5eb5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240090.092908:0:14064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782240090.092910:0:14064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782240090.092911:0:14064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782240090.092985:0:14712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1782240090.092991:0:14712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b25db6fd/0x8c5345f1c1ec5eb5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782240090.093801:0:14712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782240090.093809:0:14712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000173aade9/0x8c5345f1c1ec5ebc lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.093822:0:14712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=469s v=(0 0) 00010000:00010000:0.0:1782240090.093827:0:14712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782240090.093832:0:14712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000173aade9/0x8c5345f1c1ec5ebc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.093856:0:14712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000173aade9/0x8c5345f1c1ec5ebc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.093867:0:14712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000173aade9/0x8c5345f1c1ec5ebc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.093875:0:14712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000173aade9/0x8c5345f1c1ec5ebc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240090.093927:0:14065:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782240090.093933:0:14065:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000173aade9/0x8c5345f1c1ec5ebc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240090.093941:0:14065:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f4437a00 already unused, calling callback (ffffffffc1728ce0) 00010000:00010000:2.0:1782240090.093944:0:14065:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000173aade9/0x8c5345f1c1ec5ebc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240090.093952:0:14065:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000173aade9/0x8c5345f1c1ec5ebc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240090.093967:0:14065:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000173aade9/0x8c5345f1c1ec5ebc lrc: 2/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240090.093983:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782240090.093984:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782240090.093986:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782240090.094045:0:14712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1782240090.094051:0:14712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000173aade9/0x8c5345f1c1ec5ebc lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782240090.094522:0:14712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782240090.094527:0:14712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f143d23/0x8c5345f1c1ec5ec3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.094537:0:14712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=469s v=(0 0) 00010000:00010000:0.0:1782240090.094540:0:14712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782240090.094545:0:14712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f143d23/0x8c5345f1c1ec5ec3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.094555:0:14712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004f143d23/0x8c5345f1c1ec5ec3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.094574:0:14712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f143d23/0x8c5345f1c1ec5ec3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.094582:0:14712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004f143d23/0x8c5345f1c1ec5ec3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240090.094685:0:14064:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782240090.094691:0:14064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004f143d23/0x8c5345f1c1ec5ec3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240090.094698:0:14064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f4436400 already unused, calling callback (ffffffffc1728ce0) 00010000:00010000:2.0:1782240090.094702:0:14064:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004f143d23/0x8c5345f1c1ec5ec3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240090.094711:0:14064:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004f143d23/0x8c5345f1c1ec5ec3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240090.094722:0:14064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004f143d23/0x8c5345f1c1ec5ec3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240090.094729:0:14064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782240090.094731:0:14064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782240090.094733:0:14064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782240090.094837:0:14712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1782240090.094843:0:14712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004f143d23/0x8c5345f1c1ec5ec3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782240090.096843:0:14712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782240090.096862:0:14712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f9c7d81/0x8c5345f1c1ec5eca lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.096881:0:14712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=469s v=(0 0) 00010000:00010000:0.0:1782240090.096886:0:14712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782240090.096893:0:14712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f9c7d81/0x8c5345f1c1ec5eca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.096908:0:14712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004f9c7d81/0x8c5345f1c1ec5eca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.096920:0:14712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f9c7d81/0x8c5345f1c1ec5eca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.096943:0:14712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004f9c7d81/0x8c5345f1c1ec5eca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240090.099192:0:14065:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782240090.099216:0:14065:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004f9c7d81/0x8c5345f1c1ec5eca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240090.099232:0:14065:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f4436000 already unused, calling callback (ffffffffc1728ce0) 00010000:00010000:2.0:1782240090.099238:0:14065:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004f9c7d81/0x8c5345f1c1ec5eca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240090.099273:0:14065:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004f9c7d81/0x8c5345f1c1ec5eca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240090.099302:0:14065:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004f9c7d81/0x8c5345f1c1ec5eca lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.099693:0:14712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1782240090.099704:0:14712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004f9c7d81/0x8c5345f1c1ec5eca lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240090.100568:0:14064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782240090.100578:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782240090.100581:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782240090.100583:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782240090.100828:0:14712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782240090.100838:0:14712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039e79703/0x8c5345f1c1ec5ed1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.100855:0:14712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=469s v=(0 0) 00010000:00010000:0.0:1782240090.100861:0:14712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782240090.100869:0:14712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000039e79703/0x8c5345f1c1ec5ed1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.100886:0:14712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000039e79703/0x8c5345f1c1ec5ed1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.100901:0:14712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039e79703/0x8c5345f1c1ec5ed1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.100910:0:14712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000039e79703/0x8c5345f1c1ec5ed1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.100941:0:14712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782240090.100953:0:14064:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782240090.100963:0:14064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000039e79703/0x8c5345f1c1ec5ed1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240090.100975:0:14064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5c0031800 already unused, calling callback (ffffffffc1728ce0) 00010000:00010000:3.0:1782240090.100980:0:14064:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000039e79703/0x8c5345f1c1ec5ed1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240090.100990:0:14064:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000039e79703/0x8c5345f1c1ec5ed1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240090.101011:0:14064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000039e79703/0x8c5345f1c1ec5ed1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240090.101020:0:14064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000039e79703/0x8c5345f1c1ec5ed1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240090.101043:0:14064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782240090.101045:0:14064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782240090.101048:0:14064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782240090.101354:0:14712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782240090.101360:0:14712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a7afe43/0x8c5345f1c1ec5ed8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.101370:0:14712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=469s v=(0 0) 00010000:00010000:0.0:1782240090.101373:0:14712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782240090.101377:0:14712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a7afe43/0x8c5345f1c1ec5ed8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.101387:0:14712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a7afe43/0x8c5345f1c1ec5ed8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.101394:0:14712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a7afe43/0x8c5345f1c1ec5ed8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.101402:0:14712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008a7afe43/0x8c5345f1c1ec5ed8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.101421:0:14712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782240090.101529:0:14065:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782240090.101536:0:14065:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008a7afe43/0x8c5345f1c1ec5ed8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240090.101560:0:14065:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5c0031a00 already unused, calling callback (ffffffffc1728ce0) 00010000:00010000:3.0:1782240090.101565:0:14065:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008a7afe43/0x8c5345f1c1ec5ed8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240090.101574:0:14065:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008a7afe43/0x8c5345f1c1ec5ed8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240090.101589:0:14065:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008a7afe43/0x8c5345f1c1ec5ed8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240090.101598:0:14065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a7afe43/0x8c5345f1c1ec5ed8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240090.101616:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782240090.101618:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782240090.101620:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782240090.101864:0:14712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782240090.101871:0:14712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb62dd40/0x8c5345f1c1ec5edf lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.101879:0:14712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=469s v=(0 0) 00010000:00010000:0.0:1782240090.101888:0:14712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782240090.101892:0:14712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb62dd40/0x8c5345f1c1ec5edf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.101901:0:14712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb62dd40/0x8c5345f1c1ec5edf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.101909:0:14712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb62dd40/0x8c5345f1c1ec5edf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.101917:0:14712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fb62dd40/0x8c5345f1c1ec5edf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.101938:0:14712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782240090.102533:0:14064:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782240090.102542:0:14064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fb62dd40/0x8c5345f1c1ec5edf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240090.102552:0:14064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5c0031000 already unused, calling callback (ffffffffc1728ce0) 00010000:00010000:3.0:1782240090.102557:0:14064:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb62dd40/0x8c5345f1c1ec5edf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240090.102566:0:14064:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb62dd40/0x8c5345f1c1ec5edf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240090.102594:0:14064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fb62dd40/0x8c5345f1c1ec5edf lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240090.102601:0:14064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb62dd40/0x8c5345f1c1ec5edf lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240090.102624:0:14064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782240090.102626:0:14064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782240090.102628:0:14064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782240090.106369:0:14712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782240090.106390:0:14712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f079b187/0x8c5345f1c1ec5ee6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.106413:0:14712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=469s v=(0 0) 00010000:00010000:0.0:1782240090.106418:0:14712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782240090.106426:0:14712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f079b187/0x8c5345f1c1ec5ee6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.106445:0:14712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f079b187/0x8c5345f1c1ec5ee6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.106458:0:14712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f079b187/0x8c5345f1c1ec5ee6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.106492:0:14712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f079b187/0x8c5345f1c1ec5ee6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.106518:0:14712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782240090.107869:0:14065:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782240090.107884:0:14065:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f079b187/0x8c5345f1c1ec5ee6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240090.107901:0:14065:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5c0030c00 already unused, calling callback (ffffffffc1728ce0) 00010000:00010000:3.0:1782240090.107907:0:14065:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f079b187/0x8c5345f1c1ec5ee6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240090.107921:0:14065:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f079b187/0x8c5345f1c1ec5ee6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240090.107949:0:14065:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f079b187/0x8c5345f1c1ec5ee6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240090.107957:0:14065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f079b187/0x8c5345f1c1ec5ee6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240090.108006:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782240090.108009:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782240090.108011:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782240090.109254:0:14712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782240090.109272:0:14712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dcaea82a/0x8c5345f1c1ec5eed lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.109293:0:14712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=469s v=(0 0) 00010000:00010000:0.0:1782240090.109299:0:14712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782240090.109307:0:14712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dcaea82a/0x8c5345f1c1ec5eed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.109322:0:14712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dcaea82a/0x8c5345f1c1ec5eed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.109334:0:14712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dcaea82a/0x8c5345f1c1ec5eed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.109341:0:14712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dcaea82a/0x8c5345f1c1ec5eed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.109371:0:14712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782240090.109428:0:14064:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782240090.109729:0:14064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dcaea82a/0x8c5345f1c1ec5eed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240090.109742:0:14064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5c0031400 already unused, calling callback (ffffffffc1728ce0) 00010000:00010000:3.0:1782240090.109882:0:14064:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dcaea82a/0x8c5345f1c1ec5eed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240090.109895:0:14064:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dcaea82a/0x8c5345f1c1ec5eed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240090.109920:0:14064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dcaea82a/0x8c5345f1c1ec5eed lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240090.109929:0:14064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dcaea82a/0x8c5345f1c1ec5eed lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240090.109958:0:14064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782240090.109960:0:14064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782240090.109962:0:14712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1782240090.109963:0:14064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782240090.109971:0:14712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c06bda8/0x8c5345f1c1ec5ef4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.109988:0:14712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=469s v=(0 0) 00010000:00010000:0.0:1782240090.109992:0:14712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782240090.109996:0:14712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c06bda8/0x8c5345f1c1ec5ef4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.110007:0:14712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c06bda8/0x8c5345f1c1ec5ef4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.110016:0:14712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c06bda8/0x8c5345f1c1ec5ef4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.110025:0:14712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008c06bda8/0x8c5345f1c1ec5ef4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240090.110045:0:14712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782240090.110137:0:14065:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782240090.110144:0:14065:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008c06bda8/0x8c5345f1c1ec5ef4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240090.110166:0:14065:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5c0030400 already unused, calling callback (ffffffffc1728ce0) 00010000:00010000:3.0:1782240090.110170:0:14065:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008c06bda8/0x8c5345f1c1ec5ef4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240090.110179:0:14065:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008c06bda8/0x8c5345f1c1ec5ef4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240090.110193:0:14065:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008c06bda8/0x8c5345f1c1ec5ef4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240090.110200:0:14065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c06bda8/0x8c5345f1c1ec5ef4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240090.110220:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782240090.110223:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782240090.110225:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1782240090.110245:0:14712:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:0.0:1782240090.110373:0:14712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f4895880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14099:x1868813758990080:12345-0@lo:5:osp-pre-0-0.0 Request processed in 83050us (86650us total) trans 0 rc 0/0 00000100:00100000:0.0:1782240090.110385:0:14712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1782240090.110593:0:14099:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f4897100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14099:1868813758990080:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1782240090.110615:0:14099:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:3.0:1782240090.115197:0:14099:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f4897100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14099:1868813758990208:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1782240090.115294:0:14099:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782240090.115360:0:14099:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c8460000 going to sleep for 11 seconds 00000100:00100000:1.0:1782240090.115428:0:14713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758990208 00000100:00100000:1.0:1782240090.115438:0:14713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758990208 00000100:00100000:1.0:1782240090.115505:0:14713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782240090.115517:0:14713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f4894a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14099:x1868813758990208:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1782240090.115588:0:14713:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:1.0:1782240090.136536:0:14713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f4894a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14099:x1868813758990208:12345-0@lo:5:osp-pre-0-0.0 Request processed in 21009us (21229us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1782240090.136554:0:14713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1782240090.144802:0:14099:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f4897100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14099:1868813758990208:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1782240090.144837:0:14099:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:3.0:1782240090.594708:0:14064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1782240091.296139:0:15381:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:2.0:1782240091.296143:0:15381:0:(obd_mount.c:917:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1782240091.296271:0:15381:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9bb5d1a15800 00000020:01000004:2.0:1782240091.296287:0:15381:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1782240091.296300:0:15381:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1782240091.296312:0:15381:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9bb5ef218000) 00000020:00000080:2.0:1782240091.296340:0:15381:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1782240091.331641:0:15381:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1782240091.332950:0:15381:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1782240091.334225:0:15381:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1782240091.334538:0:15381:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:1.0:1782240091.335019:0:15381:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1782240091.335595:0:15381:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 151: rc = 0 00100000:10000000:1.0:1782240091.335694:0:15381:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 151: rc = 0 00100000:10000000:1.0:1782240091.335987:0:15381:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 151: rc = 0 00100000:10000000:1.0:1782240091.345544:0:15381:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 621: rc = 0 00100000:10000000:1.0:1782240091.346245:0:15381:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 621: rc = 0 00100000:10000000:1.0:1782240091.346586:0:15381:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 621: rc = 0 00100000:10000000:0.0:1782240091.360673:0:15381:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 621: rc = 0 00100000:10000000:0.0:1782240091.361607:0:15381:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 621: rc = 0 00100000:10000000:0.0:1782240091.362318:0:15381:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 621: rc = 0 00000020:00000080:0.0:1782240091.364359:0:15381:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1782240091.364372:0:15381:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:0.0:1782240091.364385:0:15381:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x8c5345f1c1ec5f02 00000020:01000004:0.0:1782240091.364465:0:15381:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:0.0:1782240091.364494:0:15381:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.203.132@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1782240091.364499:0:15381:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.132@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1782240091.364506:0:15381:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1782240091.364531:0:15381:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:0.0:1782240091.364536:0:15381:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.132@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1782240091.396276:0:15381:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.132@tcp ctxt 0 is initialized 00000020:01000004:2.0:1782240091.396314:0:15381:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.132@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1782240091.396318:0:15381:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1782240091.396320:0:15381:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1782240091.396322:0:15381:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782240091.396323:0:15381:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782240091.396324:0:15381:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782240091.396325:0:15381:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782240091.396327:0:15381:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782240091.396328:0:15381:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782240091.396329:0:15381:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1782240091.396333:0:15381:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1782240091.396334:0:15381:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1782240091.396336:0:15381:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1782240091.396337:0:15381:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782240091.396338:0:15381:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782240091.396339:0:15381:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782240091.396341:0:15381:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782240091.396342:0:15381:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782240091.396346:0:15381:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782240091.396347:0:15381:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1782240091.396370:0:15381:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1782240091.396389:0:15381:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fbe0ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:15381:1868813758990336:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1782240091.396648:0:15381:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782240091.396872:0:15381:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c391fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1782240091.396949:0:14070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758990336 00000100:00100000:3.0:1782240091.396956:0:14070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758990336 00000100:00100000:3.0:1782240091.397010:0:14070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1782240091.397019:0:14070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ee8ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+16:15381:x1868813758990336:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1782240091.397048:0:14070:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1782240091.397051:0:14070:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:3.0:1782240091.397055:0:14070:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1782240091.416821:0:14070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ee8ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+16:15381:x1868813758990336:12345-0@lo:253:mount.lustre.0 Request processed in 19791us (20162us total) trans 0 rc 0/0 00000100:00100000:1.0:1782240091.416837:0:14070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1782240091.416999:0:15381:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fbe0ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:15381:1868813758990336:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1782240091.417015:0:15381:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1782240091.417019:0:15381:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1782240091.417021:0:15381:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1782240091.417022:0:15381:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782240091.417023:0:15381:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782240091.417025:0:15381:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782240091.417026:0:15381:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782240091.417028:0:15381:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782240091.417030:0:15381:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782240091.417031:0:15381:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1782240091.417054:0:15381:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9bb5d1a15800 from lustre-OST0001 10000000:01000000:2.0:1782240091.417077:0:15381:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1782240091.417080:0:15381:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1782240091.417097:0:15381:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9bb5ef7ab380 local copy 00010000:00010000:2.0:1782240091.417108:0:15381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e26a00/0x8c5345f1c1ec5caf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec5cb6 expref: -99 pid: 14058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782240091.417819:0:15381:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fbe0ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:15381:1868813758990464:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1782240091.417863:0:15381:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782240091.417954:0:15381:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb601a1cb40 going to sleep for 11 seconds 00000100:00100000:3.0:1782240091.418814:0:14071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758990464 00000100:00100000:3.0:1782240091.418824:0:14071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758990464 00000100:00100000:3.0:1782240091.418926:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1782240091.418936:0:14071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ee8ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+16:15381:x1868813758990464:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782240091.419187:0:14071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ee8ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+16:15381:x1868813758990464:12345-0@lo:501:mount.lustre.0 Request processed in 252us (1323us total) trans 0 rc -2/-2 00000100:00100000:3.0:1782240091.419195:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1782240091.419279:0:15381:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fbe0ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:15381:1868813758990464:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1782240091.419298:0:15381:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.132@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1782240091.419464:0:15381:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.132@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1782240091.419472:0:15381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e26a00/0x8c5345f1c1ec5caf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec5cb6 expref: -99 pid: 14058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240091.419489:0:15381:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e26a00/0x8c5345f1c1ec5caf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec5cb6 expref: -99 pid: 14058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782240091.419511:0:15381:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9bb5d1a15800 10000000:01000000:2.0:1782240091.419516:0:15381:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1782240091.419521:0:15381:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1782240091.419523:0:15381:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1782240091.419527:0:15381:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1782240091.419530:0:15381:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1782240091.419555:0:15381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5ee29f200/0x8c5345f1c1ec5f09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240091.419562:0:15381:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: ffff9bb5ee29f200/0x8c5345f1c1ec5f09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240091.419570:0:15381:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff9bb5ee29f200/0x8c5345f1c1ec5f09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782240091.419587:0:15381:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fbe0ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:15381:1868813758990592:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1782240091.419617:0:15381:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782240091.419982:0:15381:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb601a1cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1782240091.420071:0:14068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758990592 00000100:00100000:0.0:1782240091.420077:0:14068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758990592 00000100:00100000:0.0:1782240091.420114:0:14068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1782240091.420121:0:14068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ee8ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+16:15381:x1868813758990592:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1782240091.420131:0:14068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782240091.420143:0:14068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb5c0031600/0x8c5345f1c1ec5f10 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c5345f1c1ec5f09 expref: -99 pid: 14068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240091.420175:0:14068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb5c0031600/0x8c5345f1c1ec5f10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c5345f1c1ec5f09 expref: 17 pid: 14068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240091.420186:0:14068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb5c0031600/0x8c5345f1c1ec5f10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c5345f1c1ec5f09 expref: 17 pid: 14068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240091.420196:0:14068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5c0031600, rc 0) 00000100:00100000:0.0:1782240091.420238:0:14068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ee8ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+17:15381:x1868813758990592:12345-0@lo:101:mount.lustre.0 Request processed in 117us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1782240091.420245:0:14068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1782240091.420323:0:15381:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fbe0ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:15381:1868813758990592:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1782240091.420336:0:15381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff9bb5ee29f200/0x8c5345f1c1ec5f09 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec5f10 expref: -99 pid: 15381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240091.420344:0:15381:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff9bb5ee29f200/0x8c5345f1c1ec5f09 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c5345f1c1ec5f10 expref: -99 pid: 15381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782240091.420984:0:15381:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1782240091.421739:0:15381:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1782240091.422034:0:15381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1782240091.422074:0:15381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1782240091.422119:0:15381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1782240091.422159:0:15381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1782240091.422195:0:15381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1782240091.422225:0:15381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1782240091.422294:0:15381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1782240091.422301:0:15381:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1782240091.422368:0:15381:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fbe0ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:15381:1868813758990720:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1782240091.422425:0:15381:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782240091.422448:0:15381:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb601a1c600 going to sleep for 11 seconds 00000100:00100000:0.0:1782240091.423321:0:14068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758990720 00000100:00100000:0.0:1782240091.423330:0:14068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758990720 00000100:00100000:0.0:1782240091.423378:0:14068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1782240091.423387:0:14068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ee8ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+17:15381:x1868813758990720:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782240091.423855:0:14068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ee8ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+17:15381:x1868813758990720:12345-0@lo:501:mount.lustre.0 Request processed in 468us (1429us total) trans 0 rc 0/0 00000100:00100000:0.0:1782240091.423871:0:14068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1782240091.424535:0:15381:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fbe0ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:15381:1868813758990720:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1782240091.424578:0:15381:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fbe0ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:15381:1868813758990848:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1782240091.424621:0:15381:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782240091.424656:0:15381:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb601a1c600 going to sleep for 11 seconds 00000100:00100000:3.0:1782240091.424850:0:14071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758990848 00000100:00100000:3.0:1782240091.424856:0:14071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758990848 00000100:00100000:3.0:1782240091.424890:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1782240091.424897:0:14071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ee8efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+17:15381:x1868813758990848:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1782240091.425237:0:14071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ee8efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+17:15381:x1868813758990848:12345-0@lo:503:mount.lustre.0 Request processed in 336us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1782240091.425244:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1782240091.425398:0:15381:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fbe0ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:15381:1868813758990848:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1782240091.426960:0:15381:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1782240091.427048:0:15381:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fbe0ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:15381:1868813758990976:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1782240091.427130:0:15381:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782240091.427177:0:15381:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb601a1c600 going to sleep for 11 seconds 00000100:00100000:3.0:1782240091.427595:0:14071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758990976 00000100:00100000:3.0:1782240091.427601:0:14071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758990976 00000100:00100000:3.0:1782240091.427638:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1782240091.427646:0:14071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ee01b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+17:15381:x1868813758990976:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782240091.427958:0:14071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ee01b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+17:15381:x1868813758990976:12345-0@lo:502:mount.lustre.0 Request processed in 311us (827us total) trans 0 rc 0/0 00000100:00100000:3.0:1782240091.427971:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1782240091.428211:0:15381:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fbe0ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:15381:1868813758990976:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1782240091.428630:0:15381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1782240091.428687:0:15381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1782240091.429070:0:15381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1782240091.429143:0:15381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1782240091.429260:0:15381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1782240091.429300:0:15381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1782240091.429351:0:15381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1782240091.429666:0:15381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1782240091.429831:0:15381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:3.0:1782240091.429876:0:15381:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f4897480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:15381:1868813758991104:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782240091.429942:0:15381:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782240091.430073:0:15381:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c8460c00 going to sleep for 11 seconds 00000100:00100000:1.0:1782240091.430156:0:14070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758991104 00000100:00100000:1.0:1782240091.430163:0:14070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758991104 00000100:00100000:2.0:1782240091.430676:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1782240091.430688:0:14071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ee01b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+17:15381:x1868813758991104:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1782240091.432439:0:14071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ee01b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+17:15381:x1868813758991104:12345-0@lo:502:mount.lustre.0 Request processed in 1747us (2490us total) trans 0 rc 0/0 00000100:00100000:2.0:1782240091.432453:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1782240091.432528:0:15381:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f4897480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:15381:1868813758991104:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1782240091.432667:0:15381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:1.0:1782240091.432682:0:15381:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:1.0:1782240091.434664:0:15382:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1782240091.434675:0:15382:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1782240091.434681:0:15382:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782240091.434683:0:15382:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1782240091.434688:0:15382:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1782240091.434801:0:15382:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9bb6018299c0) 00000020:00000080:1.0:1782240091.434825:0:15382:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:1.0:1782240091.434832:0:15382:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1782240091.434908:0:15382:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bb5d1a15800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1782240091.434917:0:15382:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:1.0:1782240091.434924:0:15382:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x8c5345f1c1ec5f1e 00010000:00010000:1.0:1782240091.445233:0:15382:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:1.0:1782240091.448302:0:15382:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:1.0:1782240091.454687:0:15382:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1782240091.459423:0:15382:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1782240091.459435:0:15382:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782240091.459442:0:15382:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782240091.459444:0:15382:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1782240091.459447:0:15382:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782240091.459452:0:15382:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782240091.459454:0:15382:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1782240091.459458:0:15382:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1782240091.459460:0:15382:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1782240091.459462:0:15382:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782240091.459466:0:15382:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782240091.459467:0:15382:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:0.0:1782240091.459470:0:15382:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782240091.459472:0:15382:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782240091.459474:0:15382:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1782240091.459478:0:15382:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1782240091.459539:0:15382:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782240091.459542:0:15382:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782240091.459544:0:15382:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1782240091.459548:0:15382:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:1.0:1782240091.459827:0:15381:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1782240091.459854:0:15381:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1782240091.459868:0:15381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5ee29f200/0x8c5345f1c1ec5f09 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec5f10 expref: -99 pid: 15381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240091.459896:0:15381:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff9bb5ee29f200/0x8c5345f1c1ec5f09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec5f10 expref: -99 pid: 15381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782240091.459904:0:15381:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9bb5d1a15800 from 1 10000000:01000000:1.0:1782240091.459907:0:15381:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1782240091.459938:0:15381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e38c00/0x8c5345f1c1ec5f25 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240091.459944:0:15381:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e38c00/0x8c5345f1c1ec5f25 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240091.459954:0:15381:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e38c00/0x8c5345f1c1ec5f25 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782240091.459976:0:15381:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fc2a9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:15381:1868813758991232:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1782240091.460038:0:15381:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782240091.460072:0:15381:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5d1a60180 going to sleep for 11 seconds 00000100:00100000:0.0:1782240091.460859:0:14071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758991232 00000100:00100000:0.0:1782240091.460868:0:14071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758991232 00000100:00100000:0.0:1782240091.460921:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1782240091.460931:0:14071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ee019450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+17:15381:x1868813758991232:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1782240091.460945:0:14071:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782240091.460958:0:14071:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb5c0030000/0x8c5345f1c1ec5f2c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c5345f1c1ec5f25 expref: -99 pid: 14071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240091.460983:0:14071:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb5c0030000/0x8c5345f1c1ec5f2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c5345f1c1ec5f25 expref: 18 pid: 14071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240091.461004:0:14071:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb5c0030000/0x8c5345f1c1ec5f2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c5345f1c1ec5f25 expref: 18 pid: 14071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240091.461012:0:14071:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5c0030000, rc 0) 00000100:00100000:0.0:1782240091.461072:0:14071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ee019450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+18:15381:x1868813758991232:12345-0@lo:101:mount.lustre.0 Request processed in 142us (1033us total) trans 0 rc 0/0 00000100:00100000:0.0:1782240091.461079:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1782240091.461443:0:15381:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fc2a9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:15381:1868813758991232:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1782240091.461461:0:15381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e38c00/0x8c5345f1c1ec5f25 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec5f2c expref: -99 pid: 15381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240091.461472:0:15381:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e38c00/0x8c5345f1c1ec5f25 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c5345f1c1ec5f2c expref: -99 pid: 15381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782240091.465674:0:15381:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1782240091.466265:0:15381:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782240091.468260:0:15381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1782240091.468324:0:15381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1782240091.468392:0:15381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1782240091.468400:0:15381:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1782240091.468654:0:15381:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f4896d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:15381:1868813758991360:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782240091.468998:0:15381:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782240091.469174:0:15381:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c8460840 going to sleep for 11 seconds 00000100:00100000:0.0:1782240091.469872:0:14070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758991360 00000100:00100000:0.0:1782240091.469881:0:14070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758991360 00000100:00100000:0.0:1782240091.469977:0:14070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1782240091.469986:0:14070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ee019c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+18:15381:x1868813758991360:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782240091.470291:0:14070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ee019c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+18:15381:x1868813758991360:12345-0@lo:501:mount.lustre.0 Request processed in 305us (1293us total) trans 0 rc 0/0 00000100:00100000:0.0:1782240091.470298:0:14070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1782240091.470522:0:15381:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f4896d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:15381:1868813758991360:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782240091.470579:0:15381:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f4896d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:15381:1868813758991488:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1782240091.470624:0:15381:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782240091.473793:0:14068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758991488 00000100:00100000:1.0:1782240091.473807:0:14068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758991488 00000100:00100000:1.0:1782240091.473854:0:14068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1782240091.473863:0:14068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ee018c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+18:15381:x1868813758991488:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1782240091.474080:0:14068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ee018c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+18:15381:x1868813758991488:12345-0@lo:503:mount.lustre.0 Request processed in 217us (3454us total) trans 0 rc 0/0 00000100:00100000:1.0:1782240091.474097:0:14068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1782240091.475348:0:15381:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c8460840 going to sleep for 11 seconds 00000100:00100000:3.0:1782240091.475518:0:15381:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f4896d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:15381:1868813758991488:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1782240091.476599:0:15381:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1782240091.476680:0:15381:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f4896d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:15381:1868813758991616:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782240091.477674:0:15381:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782240091.477794:0:15381:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c8460840 going to sleep for 11 seconds 00000100:00100000:1.0:1782240091.477991:0:14068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758991616 00000100:00100000:1.0:1782240091.477999:0:14068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758991616 00000100:00100000:1.0:1782240091.478038:0:14068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1782240091.478047:0:14068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7b04050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+18:15381:x1868813758991616:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1782240091.478635:0:14068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7b04050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+18:15381:x1868813758991616:12345-0@lo:502:mount.lustre.0 Request processed in 586us (960us total) trans 0 rc 0/0 00000100:00100000:1.0:1782240091.478644:0:14068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1782240091.478863:0:15381:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f4896d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:15381:1868813758991616:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1782240091.479529:0:15381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1782240091.479604:0:15381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1782240091.479676:0:15381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1782240091.479885:0:15381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1782240091.479920:0:15381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1782240091.479974:0:15381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1782240091.480007:0:15381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1782240091.480036:0:15381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1782240091.480072:0:15381:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f4896d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:15381:1868813758991744:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782240091.481861:0:15381:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782240091.481946:0:15381:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c8460840 going to sleep for 11 seconds 00000100:00100000:0.0:1782240091.483517:0:14071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758991744 00000100:00100000:0.0:1782240091.483528:0:14071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758991744 00000100:00100000:0.0:1782240091.483584:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1782240091.483595:0:14071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7b07450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+18:15381:x1868813758991744:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1782240091.483873:0:14071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7b07450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+18:15381:x1868813758991744:12345-0@lo:502:mount.lustre.0 Request processed in 279us (2016us total) trans 0 rc 0/0 00000100:00100000:0.0:1782240091.483882:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1782240091.484152:0:15381:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f4896d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:15381:1868813758991744:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1782240091.484322:0:15381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1782240091.484337:0:15381:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1782240091.487671:0:15386:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782240091.487684:0:15386:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782240091.487686:0:15386:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1782240091.487693:0:15386:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bb5d1a15800 00000020:00000080:0.0:1782240091.487696:0:15386:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1782240091.487729:0:15386:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782240091.487732:0:15386:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782240091.487734:0:15386:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1782240091.487736:0:15386:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782240091.487739:0:15386:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782240091.487740:0:15386:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1782240091.487743:0:15386:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bb5d1a15800 00000020:00000080:0.0:1782240091.487778:0:15386:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1782240091.487838:0:15386:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782240091.487842:0:15386:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782240091.487844:0:15386:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1782240091.487846:0:15386:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782240091.487849:0:15386:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782240091.487850:0:15386:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1782240091.487853:0:15386:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9bb5d1a15800 00000020:00000080:0.0:1782240091.487855:0:15386:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1782240091.487891:0:15386:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782240091.487894:0:15386:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782240091.487896:0:15386:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1782240091.487899:0:15386:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1782240091.488133:0:15381:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1782240091.488179:0:15381:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1782240091.488204:0:15381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e38c00/0x8c5345f1c1ec5f25 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec5f2c expref: -99 pid: 15381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240091.488216:0:15381:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e38c00/0x8c5345f1c1ec5f25 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec5f2c expref: -99 pid: 15381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782240091.488286:0:15381:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1782240091.488291:0:15381:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9bb5d1a15800 10000000:01000000:3.0:1782240091.488294:0:15381:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9bb5d1a15800 10000000:01000000:3.0:1782240091.488299:0:15381:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1782240091.488304:0:15381:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9bb5d1a15800 from 1 10000000:01000000:3.0:1782240091.488307:0:15381:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1782240091.488343:0:15381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e26c00/0x8c5345f1c1ec5f33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240091.488353:0:15381:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e26c00/0x8c5345f1c1ec5f33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240091.488377:0:15381:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e26c00/0x8c5345f1c1ec5f33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782240091.488411:0:15381:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f4896d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:15381:1868813758991872:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1782240091.488477:0:15381:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782240091.488513:0:15381:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c8460cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1782240091.489536:0:14068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758991872 00000100:00100000:0.0:1782240091.489550:0:14068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758991872 00000100:00100000:0.0:1782240091.489606:0:14068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1782240091.489617:0:14068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7b04c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+18:15381:x1868813758991872:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1782240091.489633:0:14068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782240091.489648:0:14068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb5c0030a00/0x8c5345f1c1ec5f3a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c5345f1c1ec5f33 expref: -99 pid: 14068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240091.489671:0:14068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb5c0030a00/0x8c5345f1c1ec5f3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c5345f1c1ec5f33 expref: 19 pid: 14068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240091.489681:0:14068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb5c0030a00/0x8c5345f1c1ec5f3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c5345f1c1ec5f33 expref: 19 pid: 14068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240091.489696:0:14068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5c0030a00, rc 0) 00000100:00100000:0.0:1782240091.489906:0:14068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7b04c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+19:15381:x1868813758991872:12345-0@lo:101:mount.lustre.0 Request processed in 290us (1428us total) trans 0 rc 0/0 00000100:00100000:0.0:1782240091.489913:0:14068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1782240091.493373:0:15381:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f4896d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:15381:1868813758991872:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1782240091.493406:0:15381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e26c00/0x8c5345f1c1ec5f33 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec5f3a expref: -99 pid: 15381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240091.493421:0:15381:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e26c00/0x8c5345f1c1ec5f33 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c5345f1c1ec5f3a expref: -99 pid: 15381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782240091.496137:0:15381:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1782240091.496464:0:15381:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782240091.496705:0:15381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1782240091.496773:0:15381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1782240091.496811:0:15381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1782240091.496860:0:15381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1782240091.496896:0:15381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1782240091.496956:0:15381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1782240091.496998:0:15381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1782240091.497047:0:15381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1782240091.497136:0:15381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1782240091.497205:0:15381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1782240091.497243:0:15381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1782240091.497286:0:15381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1782240091.497320:0:15381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1782240091.497352:0:15381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1782240091.497395:0:15381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1782240091.497425:0:15381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1782240091.497456:0:15381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1782240091.497499:0:15381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1782240091.497528:0:15381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1782240091.497555:0:15381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1782240091.497600:0:15381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1782240091.497634:0:15381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1782240091.497672:0:15381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1782240091.497727:0:15381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1782240091.497794:0:15381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1782240091.497837:0:15381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1782240091.497889:0:15381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1782240091.497927:0:15381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1782240091.497988:0:15381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1782240091.498045:0:15381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:3.0:1782240091.498097:0:15381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:3.0:1782240091.498135:0:15381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:3.0:1782240091.498168:0:15381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:3.0:1782240091.498232:0:15381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:3.0:1782240091.498269:0:15381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:3.0:1782240091.498314:0:15381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:3.0:1782240091.498351:0:15381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:3.0:1782240091.498440:0:15381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:3.0:1782240091.498448:0:15381:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:3.0:1782240091.498563:0:15381:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f4896680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:15381:1868813758992000:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782240091.498631:0:15381:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782240091.498690:0:15381:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c8460240 going to sleep for 11 seconds 00000100:00100000:0.0:1782240091.501074:0:14071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758992000 00000100:00100000:0.0:1782240091.501100:0:14071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758992000 00000100:00100000:0.0:1782240091.501154:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1782240091.501220:0:14071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7b05050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+19:15381:x1868813758992000:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782240091.501603:0:14071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7b05050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+19:15381:x1868813758992000:12345-0@lo:501:mount.lustre.0 Request processed in 439us (2970us total) trans 0 rc 0/0 00000100:00100000:0.0:1782240091.501611:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1782240091.501862:0:15381:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f4896680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:15381:1868813758992000:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782240091.502240:0:15381:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f4896680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:15381:1868813758992128:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1782240091.502290:0:15381:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782240091.502325:0:15381:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c8460240 going to sleep for 11 seconds 00000100:00100000:1.0:1782240091.502655:0:14068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758992128 00000100:00100000:1.0:1782240091.502661:0:14068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758992128 00000100:00100000:1.0:1782240091.502701:0:14068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1782240091.502709:0:14068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7b04850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+19:15381:x1868813758992128:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1782240091.502969:0:14068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7b04850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+19:15381:x1868813758992128:12345-0@lo:503:mount.lustre.0 Request processed in 259us (678us total) trans 0 rc 0/0 00000100:00100000:1.0:1782240091.502977:0:14068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1782240091.503154:0:15381:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f4896680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:15381:1868813758992128:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1782240091.506385:0:15381:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1782240091.506476:0:15381:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f4896680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:15381:1868813758992256:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782240091.525323:0:15381:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782240091.525372:0:15381:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c8460240 going to sleep for 11 seconds 00000100:00100000:0.0:1782240091.529798:0:14070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758992256 00000100:00100000:0.0:1782240091.529810:0:14070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758992256 00000100:00100000:0.0:1782240091.529859:0:14070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1782240091.529867:0:14070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+19:15381:x1868813758992256:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1782240091.530279:0:14070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+19:15381:x1868813758992256:12345-0@lo:502:mount.lustre.0 Request processed in 294us (4845us total) trans 0 rc 0/0 00000100:00100000:0.0:1782240091.530286:0:14070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1782240091.531034:0:15381:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f4896680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:15381:1868813758992256:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1782240091.531356:0:15381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1782240091.531943:0:15381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1782240091.531985:0:15381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1782240091.532048:0:15381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1782240091.532098:0:15381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1782240091.532144:0:15381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1782240091.532413:0:15381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1782240091.532448:0:15381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1782240091.532504:0:15381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1782240091.532533:0:15381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1782240091.532558:0:15381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1782240091.532595:0:15381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1782240091.532624:0:15381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1782240091.532734:0:15381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1782240091.532819:0:15381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1782240091.532852:0:15381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1782240091.532881:0:15381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1782240091.533001:0:15381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1782240091.533034:0:15381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1782240091.533064:0:15381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1782240091.533119:0:15381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1782240091.533152:0:15381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1782240091.534333:0:15381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1782240091.534491:0:15381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1782240091.534543:0:15381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1782240091.534576:0:15381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1782240091.534623:0:15381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1782240091.534653:0:15381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1782240091.534680:0:15381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1782240091.534718:0:15381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1782240091.534763:0:15381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1782240091.534795:0:15381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1782240091.534821:0:15381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1782240091.534860:0:15381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1782240091.534889:0:15381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1782240091.536488:0:15381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1782240091.536551:0:15381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1782240091.536586:0:15381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1782240091.536633:0:15381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1782240091.536668:0:15381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1782240091.536716:0:15381:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fbe0ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:15381:1868813758992384:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1782240091.536832:0:15381:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782240091.536874:0:15381:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb601a1ccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1782240091.537364:0:14071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758992384 00000100:00100000:3.0:1782240091.537373:0:14071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758992384 00000100:00100000:3.0:1782240091.537987:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1782240091.537999:0:14071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+19:15381:x1868813758992384:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782240091.539139:0:14071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+19:15381:x1868813758992384:12345-0@lo:502:mount.lustre.0 Request processed in 1137us (2301us total) trans 0 rc 0/0 00000100:00100000:3.0:1782240091.539148:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1782240091.539613:0:15381:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fbe0ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:15381:1868813758992384:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1782240091.540256:0:15381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1782240091.540279:0:15381:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1782240091.549915:0:15391:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1782240091.549932:0:15391:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9bb5dee38000) 00000020:00000080:0.0:1782240091.549952:0:15391:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:0.0:1782240091.550129:0:15391:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bb5d1a15800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1782240091.550133:0:15391:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bb5d1a15800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1782240091.550136:0:15391:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9bb5d1a15800 3 00010000:00080000:0.0:1782240091.550174:0:15391:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bb5f521f000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.132@tcp at head 00010000:00010000:0.0:1782240091.551713:0:15391:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:0.0:1782240091.551848:0:15391:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1782240091.551884:0:15391:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1782240091.551895:0:15391:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x8c5345f1c1ec5f48 00000100:00080000:0.0:1782240091.551905:0:15391:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1782240091.551910:0:15391:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9bb5f521f000 using connection 192.168.203.132@tcp/0@lo 00000100:00100000:0.0:1782240091.551952:0:15391:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bb5f77a4380 x1868813758992512/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1782240091.551983:0:15391:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1782240091.552043:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1782240091.552048:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1782240091.552050:0:36:0:(import.c:65:import_set_state_nolock()) ffff9bb5fbba2800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1782240091.552054:0:36:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 469 00000100:00080000:0.0:1782240091.552059:0:36:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1782240091.552063:0:36:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9bb5fbba2800 using connection 192.168.203.132@tcp/0@lo 00000100:00100000:0.0:1782240091.552074:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bb5f77a5180 x1868813758992768/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1782240091.552131:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f77a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1868813758992896:0@lo:400:kworker.0 00000100:00100000:0.0:1782240091.552193:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782240091.552226:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782240091.552232:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f77a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1868813758992640:0@lo:400:kworker.0 00000100:00100000:0.0:1782240091.552255:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782240091.552284:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782240091.552291:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f77a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1868813758993024:0@lo:400:kworker.0 00000100:00100000:0.0:1782240091.552313:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782240091.552346:0:14078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758992896 00000100:00100000:0.0:1782240091.552352:0:14078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758992896 00000100:00100000:0.0:1782240091.552392:0:14078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758993024 00000100:00100000:0.0:1782240091.552395:0:14078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758993024 00000100:00100000:0.0:1782240091.552411:0:14078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1782240091.552418:0:14078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f77a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1868813758992896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782240091.552465:0:14078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f77a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1868813758992896:12345-0@lo:400:kworker.0 Request processed in 47us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1782240091.552471:0:14078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1782240091.552482:0:14078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1782240091.552487:0:14078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f77a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1868813758993024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782240091.552513:0:14078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f77a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1868813758993024:12345-0@lo:400:kworker.0 Request processed in 26us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1782240091.552518:0:14078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1782240091.552534:0:14712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758992640 00000100:00100000:0.0:1782240091.552537:0:14712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758992640 00000100:00100000:0.0:1782240091.552557:0:14712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782240091.552563:0:14712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f77a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3307:x1868813758992640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782240091.552590:0:14712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f77a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3307:x1868813758992640:12345-0@lo:400:kworker.0 Request processed in 27us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1782240091.552596:0:14712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782240091.552632:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f77a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1868813758992640:0@lo:400:kworker.0 00010000:00080000:0.0:1782240091.552641:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bb5f77a5880 x1868813758992896/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782240107 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782240091.552650:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f77a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1868813758992896:0@lo:400:kworker.0 00010000:00080000:0.0:1782240091.552670:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bb5f77a7b80 x1868813758993024/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782240107 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782240091.552677:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f77a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1868813758993024:0@lo:400:kworker.0 00000100:00100000:3.0:1782240091.555419:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f77a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1868813758992512:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1782240091.555498:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782240091.555554:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f77a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1868813758992768:0@lo:8:kworker.0 00000100:00100000:3.0:1782240091.555579:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782240091.555739:0:14078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758992512 00000100:00100000:3.0:1782240091.555762:0:14078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758992512 00000100:00100000:3.0:1782240091.555797:0:14078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1782240091.555804:0:14078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f4896680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3303:x1868813758992512:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1782240091.555831:0:14078:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 470 last 0 00000020:00000080:3.0:1782240091.555881:0:14078:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x8c5345f1c1ec5f4f 00000004:00100000:3.0:1782240091.555896:0:14078:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1782240091.555932:0:14078:0:(import.c:65:import_set_state_nolock()) ffff9bb5f5195000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782240091.555994:0:14078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f4896680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1868813758992512:12345-0@lo:38:llog_process_th.0 Request processed in 189us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1782240091.556002:0:14078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1782240091.556026:0:14713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758992768 00000100:00100000:3.0:1782240091.556029:0:14713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758992768 00000100:00100000:3.0:1782240091.556047:0:14713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1782240091.556051:0:14713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f4896300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3303:x1868813758992768:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1782240091.556099:0:14713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f4896300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3303:x1868813758992768:12345-0@lo:8:kworker.0 Request processed in 31us (504us total) trans 0 rc -11/-11 00000100:00100000:3.0:1782240091.556105:0:14713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1782240091.556141:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bb5f77a4380 x1868813758992512/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782240101 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782240091.556151:0:3303:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1782240091.556158:0:3303:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1782240091.556736:0:3303:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1782240091.556744:0:3303:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1782240091.556771:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9bb5f521f000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1782240091.556779:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f77a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1868813758992512:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1782240091.556797:0:3303:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1782240091.556813:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9bb5fbba2800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1782240091.556817:0:3303:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1782240091.556820:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f77a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1868813758992768:0@lo:8:kworker.0 00000040:00080000:2.0:1782240091.569335:0:15391:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:3.0:1782240091.569685:0:15381:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1782240091.569711:0:15381:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1782240091.569774:0:15381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e26c00/0x8c5345f1c1ec5f33 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec5f3a expref: -99 pid: 15381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240091.569787:0:15381:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e26c00/0x8c5345f1c1ec5f33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec5f3a expref: -99 pid: 15381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1782240091.569833:0:15381:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1782240091.569835:0:15381:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1782240091.569837:0:15381:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782240091.569838:0:15381:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782240091.569839:0:15381:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782240091.569840:0:15381:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782240091.569842:0:15381:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1782240091.569843:0:15381:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782240091.569845:0:15381:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1782240091.569849:0:15381:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1782240091.569851:0:15381:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1782240091.569852:0:15381:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1782240091.569853:0:15381:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782240091.569854:0:15381:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782240091.569855:0:15381:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782240091.569856:0:15381:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782240091.569857:0:15381:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1782240091.569858:0:15381:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782240091.569859:0:15381:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1782240091.569882:0:15381:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1782240091.569899:0:15381:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f4895500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:15381:1868813758993152:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1782240091.569974:0:15381:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782240091.570004:0:15381:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c8460840 going to sleep for 11 seconds 00000100:00100000:0.0:1782240091.571404:0:14068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758993152 00000100:00100000:0.0:1782240091.571418:0:14068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758993152 00000100:00100000:0.0:1782240091.571470:0:14068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1782240091.571479:0:14068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+19:15381:x1868813758993152:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1782240091.571521:0:14068:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1782240091.571535:0:14068:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00010000:1.0:1782240091.616026:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:1.0:1782240091.635096:0:14068:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1782240091.635117:0:14068:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1782240091.639282:0:14092:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1782240091.639293:0:14092:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1782240091.639321:0:14092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bb5ee29fc00/0x8c5345f1c1ec5f56 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240091.639339:0:14092:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bb5ee29e000/0x8c5345f1c1ec5e30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c5345f1c1ec5e29 expref: 19 pid: 14071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240091.639349:0:14092:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bb5ee29fc00/0x8c5345f1c1ec5f56 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240091.639391:0:14092:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bb5ee29e000/0x8c5345f1c1ec5e30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8c5345f1c1ec5e29 expref: 19 pid: 14071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240091.639405:0:14092:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bb5ee29e000/0x8c5345f1c1ec5e30 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8c5345f1c1ec5e29 expref: 19 pid: 14071 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782240091.639418:0:14092:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fbe0ad80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14092:1868813758993280:0@lo:104: 00000100:00100000:2.0:1782240091.639483:0:14092:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782240091.639536:0:14092:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb601a1c9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782240091.639613:0:14059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758993280 00000100:00100000:1.0:1782240091.639621:0:14059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758993280 00000100:00100000:1.0:1782240091.639677:0:14059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782240091.639686:0:14059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fbe09c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+3:14092:x1868813758993280:12345-0@lo:104: 00010000:00010000:1.0:1782240091.639697:0:14059:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.132@tcp lock: ffff9bb5f4436e00/0x8c5345f1c1ec5e29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c5345f1c1ec5e30 expref: -99 pid: 14073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240091.639851:0:14059:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782240091.639858:0:14059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fbe09c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+3:14092:x1868813758993280:12345-0@lo:104: Request processed in 173us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1782240091.639864:0:14059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1782240091.639884:0:14064:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782240091.639889:0:14064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.132@tcp lock: ffff9bb5f4436e00/0x8c5345f1c1ec5e29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c5345f1c1ec5e30 expref: -99 pid: 14073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240091.639911:0:14064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f4436e00 already unused, calling callback (ffffffffc1d0cc20) 10000000:00010000:1.0:1782240091.639914:0:14064:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.132@tcp lock: ffff9bb5f4436e00/0x8c5345f1c1ec5e29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8c5345f1c1ec5e30 expref: -99 pid: 14073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240091.639922:0:14064:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.132@tcp lock: ffff9bb5f4436e00/0x8c5345f1c1ec5e29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8c5345f1c1ec5e30 expref: -99 pid: 14073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782240091.639929:0:14064:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.132@tcp lock: ffff9bb5f4436e00/0x8c5345f1c1ec5e29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8c5345f1c1ec5e30 expref: -99 pid: 14073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782240091.639934:0:14064:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1782240091.639960:0:14064:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.132@tcp lock: ffff9bb5f4436e00/0x8c5345f1c1ec5e29 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c5345f1c1ec5e30 expref: -99 pid: 14073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240091.639967:0:14064:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782240091.639987:0:14064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.132@tcp lock: ffff9bb5f4436e00/0x8c5345f1c1ec5e29 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c5345f1c1ec5e30 expref: -99 pid: 14073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240091.639993:0:14064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.132@tcp lock: ffff9bb5f4436e00/0x8c5345f1c1ec5e29 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c5345f1c1ec5e30 expref: -99 pid: 14073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240091.640012:0:14064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782240091.640015:0:14064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782240091.640017:0:14064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782240091.640041:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fc2a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:3305:1868813758993408:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782240091.640073:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782240091.640700:0:14092:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fbe0ad80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14092:1868813758993280:0@lo:104: 00010000:00010000:1.0:1782240091.640718:0:14092:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bb5ee29fc00/0x8c5345f1c1ec5f56 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782240091.641010:0:14063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758993408 00000100:00100000:0.0:1782240091.641017:0:14063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758993408 00010000:00010000:0.0:1782240091.641050:0:14063:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bb5ee29e000/0x8c5345f1c1ec5e30 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c5345f1c1ec5e29 expref: 20 pid: 14071 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782240091.641076:0:14063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1782240091.641094:0:14063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc2aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+20:3305:x1868813758993408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782240091.641109:0:14063:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782240091.641115:0:14063:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bb5ee29e000/0x8c5345f1c1ec5e30 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c5345f1c1ec5e29 expref: 20 pid: 14071 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240091.641126:0:14063:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bb5ee29e000/0x8c5345f1c1ec5e30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8c5345f1c1ec5e29 expref: 20 pid: 14071 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240091.641142:0:14063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb5ee29e000/0x8c5345f1c1ec5e30 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8c5345f1c1ec5e29 expref: 20 pid: 14071 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240091.641158:0:14063:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bb5ee29fc00/0x8c5345f1c1ec5f56 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240091.641167:0:14063:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb5ee29fc00/0x8c5345f1c1ec5f56 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1782240091.641182:0:14063:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004426508s 00010000:00010000:0.0:1782240091.641193:0:14063:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bb5ee29fc00/0x8c5345f1c1ec5f56 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240091.641201:0:14063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bb5ee29fc00/0x8c5345f1c1ec5f56 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240091.641208:0:14063:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bb5ee29fc00/0x8c5345f1c1ec5f56 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240091.641214:0:14063:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bb5ee29fc00/0x8c5345f1c1ec5f56 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240091.641220:0:14063:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5ee29fc00 already unused, calling callback (ffffffffc1728ce0) 00010000:00010000:0.0:1782240091.641224:0:14063:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bb5ee29fc00/0x8c5345f1c1ec5f56 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240091.641232:0:14063:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bb5ee29fc00/0x8c5345f1c1ec5f56 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240091.641246:0:14063:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bb5ee29fc00/0x8c5345f1c1ec5f56 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240091.641255:0:14063:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782240091.641301:0:14063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc2aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+19:3305:x1868813758993408:12345-0@lo:103:ldlm_bl.0 Request processed in 218us (1227us total) trans 0 rc 0/0 00000100:00100000:0.0:1782240091.641309:0:14063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782240091.641529:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fc2a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:3305:1868813758993408:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782240091.641549:0:14092:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bb5ee29fc00/0x8c5345f1c1ec5f56 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240091.641558:0:14092:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bb5ee29fc00/0x8c5345f1c1ec5f56 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240091.641565:0:14092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb5ee29fc00/0x8c5345f1c1ec5f56 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782240091.650492:0:14068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+18:15381:x1868813758993152:12345-0@lo:253:mount.lustre.0 Request processed in 79002us (80506us total) trans 0 rc 0/0 00000100:00100000:0.0:1782240091.650509:0:14068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1782240091.650651:0:15381:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f4895500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:15381:1868813758993152:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1782240091.650667:0:15381:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1782240091.650670:0:15381:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1782240091.650672:0:15381:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1782240091.650673:0:15381:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782240091.650674:0:15381:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782240091.650676:0:15381:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782240091.650677:0:15381:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782240091.650679:0:15381:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1782240091.650681:0:15381:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782240091.650682:0:15381:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1782240091.650698:0:15381:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1782240091.658606:0:15381:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1782240091.658819:0:15381:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1782240091.658972:0:15381:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1782240091.659138:0:15381:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1782240091.659298:0:15381:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1782240091.659511:0:15381:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1782240091.665857:0:15381:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1782240091.788839:0:15381:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1782240091.788849:0:15381:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1782240091.788884:0:15381:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1782240091.789152:0:15381:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.132@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1782240091.789168:0:15381:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1782240091.789195:0:15381:0:(super25.c:187:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00000001:00080000:3.0:1782240092.573182:0:6614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:3.0:1782240092.573443:0:6614:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1782240092.639084:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1782240093.023567:0:14073:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1782240093.023574:0:14073:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9bb5d204d000 from 8 10000000:01000000:1.0:1782240093.023578:0:14073:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1782240093.023622:0:14073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e38e00/0x8c5345f1c1ec5f5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240093.023634:0:14073:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e38e00/0x8c5345f1c1ec5f5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240093.023645:0:14073:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e38e00/0x8c5345f1c1ec5f5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782240093.023684:0:14073:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fc2a8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14073:1868813758993536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782240093.023780:0:14073:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782240093.024222:0:14073:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c7e7cb40 going to sleep for 11 seconds 00000100:00100000:3.0:1782240093.024294:0:14071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758993536 00000100:00100000:3.0:1782240093.024303:0:14071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758993536 00000100:00100000:3.0:1782240093.024362:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1782240093.024371:0:14071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+18:14073:x1868813758993536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782240093.024386:0:14071:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782240093.024401:0:14071:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb5f7e27400/0x8c5345f1c1ec5f64 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c5345f1c1ec5f5d expref: -99 pid: 14071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240093.024423:0:14071:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb5f7e27400/0x8c5345f1c1ec5f64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c5345f1c1ec5f5d expref: 19 pid: 14071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240093.024433:0:14071:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb5f7e27400/0x8c5345f1c1ec5f64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c5345f1c1ec5f5d expref: 19 pid: 14071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240093.024579:0:14071:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5f7e27400, rc 0) 00000100:00100000:3.0:1782240093.024632:0:14071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+19:14073:x1868813758993536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 261us (864us total) trans 0 rc 0/0 00000100:00100000:3.0:1782240093.024639:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1782240093.026297:0:14073:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fc2a8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14073:1868813758993536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782240093.026323:0:14073:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e38e00/0x8c5345f1c1ec5f5d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec5f64 expref: -99 pid: 14073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240093.026336:0:14073:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e38e00/0x8c5345f1c1ec5f5d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c5345f1c1ec5f64 expref: -99 pid: 14073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782240093.026413:0:14073:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fc2a8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14073:1868813758993664:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1782240093.026605:0:14073:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782240093.026647:0:14073:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c7e7cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1782240093.028966:0:14068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758993664 00000100:00100000:0.0:1782240093.028980:0:14068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758993664 00000100:00100000:0.0:1782240093.029042:0:14068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1782240093.029052:0:14068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+19:14073:x1868813758993664:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1782240093.029086:0:14068:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1782240093.029102:0:14068:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1782240093.029105:0:14068:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1782240093.029225:0:14068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+19:14073:x1868813758993664:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 174us (2619us total) trans 0 rc 0/0 00000100:00100000:0.0:1782240093.029233:0:14068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1782240093.031440:0:14073:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fc2a8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14073:1868813758993664:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1782240093.031640:0:14073:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1782240093.031651:0:14073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e38e00/0x8c5345f1c1ec5f5d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec5f64 expref: -99 pid: 14073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240093.031663:0:14073:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e38e00/0x8c5345f1c1ec5f5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec5f64 expref: -99 pid: 14073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240093.663732:0:14064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782240094.686973:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1782240095.267759:0:14110:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1782240095.519066:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f4895500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813758993792:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782240095.519138:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782240095.519322:0:14716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758993792 00000100:00100000:2.0:1782240095.519340:0:14716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758993792 00000100:00100000:2.0:1782240095.519397:0:14716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782240095.519406:0:14716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f77a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1868813758993792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782240095.519439:0:14716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782240095.519482:0:14716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f77a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1868813758993792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1782240095.519489:0:14716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782240095.519646:0:3306:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1782240095.519666:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f4895500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813758993792:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1782240095.520086:0:14072:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1782240095.711933:0:14064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782240096.748620:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1782240097.061234:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1782240097.061240:0:37:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1782240097.061248:0:37:0:(import.c:65:import_set_state_nolock()) ffff9bb5fbba2800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1782240097.061260:0:37:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9bb5fbba2800 using connection 192.168.203.132@tcp/0@lo 00000100:00100000:1.0:1782240097.061282:0:37:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bb5fc2a9c00 x1868813758994176/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1782240097.061505:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fc2a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:3307:1868813758993920:0@lo:400:kworker.0 00000100:00100000:1.0:1782240097.061569:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782240097.061617:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fc2a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1868813758994560:0@lo:400:kworker.0 00000100:00100000:1.0:1782240097.061645:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782240097.061681:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782240097.061686:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fc2abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1868813758994432:0@lo:400:kworker.0 00000100:00100000:1.0:1782240097.061706:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782240097.061733:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fc2aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1868813758994048:0@lo:400:kworker.0 00000100:00100000:1.0:1782240097.061792:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782240097.061809:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782240097.061814:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fc2a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1868813758994304:0@lo:400:kworker.0 00000100:00100000:1.0:1782240097.061834:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782240097.061877:0:14070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758993920 00000100:00100000:1.0:1782240097.061884:0:14070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758993920 00000100:00100000:1.0:1782240097.061923:0:14070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1782240097.061932:0:14070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+19:3307:x1868813758993920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782240097.061980:0:14070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+19:3307:x1868813758993920:12345-0@lo:400:kworker.0 Request processed in 49us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1782240097.061987:0:14070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1782240097.062014:0:14077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758994560 00000100:00100000:1.0:1782240097.062017:0:14077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758994560 00000100:00100000:1.0:1782240097.062059:0:14077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758994432 00000100:00100000:1.0:1782240097.062070:0:14077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758994432 00000100:00100000:1.0:1782240097.062087:0:14077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758994304 00000100:00100000:1.0:1782240097.062090:0:14077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758994304 00000100:00100000:1.0:1782240097.062102:0:14077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1782240097.062107:0:14077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc2ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1868813758994560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782240097.062139:0:14077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc2ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1868813758994560:12345-0@lo:400:kworker.0 Request processed in 31us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1782240097.062145:0:14077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1782240097.062156:0:14077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1782240097.062161:0:14077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc2a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1868813758994432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782240097.062185:0:14077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc2a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1868813758994432:12345-0@lo:400:kworker.0 Request processed in 24us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1782240097.062190:0:14077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1782240097.062199:0:14077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1782240097.062204:0:14077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc2ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1868813758994304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782240097.062231:0:14077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc2ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1868813758994304:12345-0@lo:400:kworker.0 Request processed in 27us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1782240097.062237:0:14077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1782240097.062267:0:14714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758994048 00000100:00100000:1.0:1782240097.062271:0:14714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758994048 00000100:00100000:1.0:1782240097.062296:0:14714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782240097.062303:0:14714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc2a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1868813758994048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782240097.062332:0:14714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc2a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1868813758994048:12345-0@lo:400:kworker.0 Request processed in 30us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1782240097.062337:0:14714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1782240097.062358:0:14072:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782240097.062362:0:14072:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1782240097.062396:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb5fc2a9f80 x1868813758994304/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782240113 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782240097.062408:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fc2a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1868813758994304:0@lo:400:kworker.0 00000100:00100000:1.0:1782240097.062419:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fc2aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1868813758994048:0@lo:400:kworker.0 00010000:00080000:1.0:1782240097.062447:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb5fc2abb80 x1868813758994432/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782240113 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782240097.062456:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fc2abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1868813758994432:0@lo:400:kworker.0 00000100:00100000:1.0:1782240097.062464:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fc2a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:3307:1868813758993920:0@lo:400:kworker.0 00010000:00080000:1.0:1782240097.062472:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb5fc2a8e00 x1868813758994560/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782240113 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782240097.062479:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fc2a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1868813758994560:0@lo:400:kworker.0 00000100:00100000:0.0:1782240097.062805:0:3303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fc2a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1868813758994176:0@lo:8:kworker.0 00000100:00100000:0.0:1782240097.062839:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782240097.063038:0:14712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758994176 00000100:00100000:1.0:1782240097.063053:0:14712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758994176 00000100:00100000:1.0:1782240097.063076:0:14712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1782240097.063081:0:14712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f77a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3303:x1868813758994176:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1782240097.063107:0:14712:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 476 last 0 00000020:00000080:1.0:1782240097.063134:0:14712:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8c5345f1c1ec5f6b 00002000:00100000:1.0:1782240097.063153:0:14712:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9bb5cfd06800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113653 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1782240097.063158:0:14712:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1782240097.063160:0:14712:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1782240097.063450:0:14712:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1782240097.063475:0:14712:0:(import.c:65:import_set_state_nolock()) ffff9bb5cfd02800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782240097.063527:0:14712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f77a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3303:x1868813758994176:12345-0@lo:8:kworker.0 Request processed in 444us (687us total) trans 0 rc 0/0 00000100:00100000:1.0:1782240097.063544:0:14712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1782240097.065282:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb5fc2a9c00 x1868813758994176/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1782240122 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1782240097.065313:0:3303:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1782240097.065326:0:3303:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1782240097.065332:0:3303:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1782240097.065335:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9bb5fbba2800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1782240097.065348:0:3303:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1782240097.065354:0:3303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fc2a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1868813758994176:0@lo:8:kworker.0 00000004:00080000:0.0:1782240097.065415:0:14101:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:0.0:1782240097.065442:0:14101:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f77a7800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14101:1868813758994816:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1782240097.065487:0:14101:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782240097.065509:0:14101:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c7f79240 going to sleep for 11 seconds 00000100:00100000:0.0:1782240097.065528:0:14713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758994816 00000100:00100000:0.0:1782240097.065533:0:14713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758994816 00000100:00100000:0.0:1782240097.065578:0:14713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1782240097.065585:0:14713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f77a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14101:x1868813758994816:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1782240097.066419:0:14100:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1782240097.066810:0:14100:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 476139060807ns, next at 0ns, rc = 0 00000100:00100000:1.0:1782240097.077053:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782240097.077080:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f77a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813758994688:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782240097.077146:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782240097.077192:0:14716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758994688 00000100:00100000:1.0:1782240097.077198:0:14716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758994688 00000100:00100000:1.0:1782240097.077242:0:14716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782240097.077251:0:14716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc2a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1868813758994688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782240097.077283:0:14716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782240097.077324:0:14716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc2a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1868813758994688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1782240097.077331:0:14716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1782240097.077370:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb5f77a5500 x1868813758994688/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782240113 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782240097.077388:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f77a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813758994688:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1782240097.077888:0:14072:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:0.0:1782240097.081533:0:14713:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1782240097.081547:0:14713:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:0.0:1782240097.081552:0:14713:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00002000:00010000:0.0:1782240097.116424:0:14713:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782240097.116438:0:14713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009509df19/0x8c5345f1c1ec5f72 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240097.116454:0:14713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=476s v=(0 0) 00010000:00010000:0.0:1782240097.116459:0:14713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782240097.116466:0:14713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009509df19/0x8c5345f1c1ec5f72 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240097.116482:0:14713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009509df19/0x8c5345f1c1ec5f72 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240097.116492:0:14713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009509df19/0x8c5345f1c1ec5f72 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240097.116501:0:14713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009509df19/0x8c5345f1c1ec5f72 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240097.116522:0:14713:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782240097.116534:0:14064:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782240097.116541:0:14064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009509df19/0x8c5345f1c1ec5f72 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240097.116549:0:14064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5c0030800 already unused, calling callback (ffffffffc1728ce0) 00010000:00010000:0.0:1782240097.116553:0:14064:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009509df19/0x8c5345f1c1ec5f72 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240097.116563:0:14064:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009509df19/0x8c5345f1c1ec5f72 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240097.116580:0:14064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009509df19/0x8c5345f1c1ec5f72 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240097.116589:0:14064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009509df19/0x8c5345f1c1ec5f72 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240097.117415:0:14064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782240097.117418:0:14064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782240097.117420:0:14064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782240097.120665:0:14713:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782240097.120682:0:14713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7fb1339/0x8c5345f1c1ec5f79 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240097.120698:0:14713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=476s v=(0 0) 00010000:00010000:0.0:1782240097.121059:0:14713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782240097.121067:0:14713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b7fb1339/0x8c5345f1c1ec5f79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240097.121085:0:14713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b7fb1339/0x8c5345f1c1ec5f79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240097.121096:0:14713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7fb1339/0x8c5345f1c1ec5f79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240097.121104:0:14713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b7fb1339/0x8c5345f1c1ec5f79 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240097.121123:0:14713:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782240097.121138:0:14065:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782240097.121144:0:14065:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b7fb1339/0x8c5345f1c1ec5f79 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240097.121153:0:14065:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5c0031200 already unused, calling callback (ffffffffc1728ce0) 00010000:00010000:0.0:1782240097.121158:0:14065:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7fb1339/0x8c5345f1c1ec5f79 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240097.121167:0:14065:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7fb1339/0x8c5345f1c1ec5f79 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240097.121185:0:14065:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b7fb1339/0x8c5345f1c1ec5f79 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240097.121205:0:14065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b7fb1339/0x8c5345f1c1ec5f79 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240097.121229:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782240097.121231:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782240097.121234:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782240097.122507:0:14713:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782240097.122517:0:14713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c06bda8/0x8c5345f1c1ec5f80 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240097.122532:0:14713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=476s v=(0 0) 00010000:00010000:0.0:1782240097.122536:0:14713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782240097.122542:0:14713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c06bda8/0x8c5345f1c1ec5f80 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240097.122554:0:14713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c06bda8/0x8c5345f1c1ec5f80 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240097.122564:0:14713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c06bda8/0x8c5345f1c1ec5f80 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240097.122572:0:14713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008c06bda8/0x8c5345f1c1ec5f80 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240097.122590:0:14713:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782240097.123129:0:14064:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782240097.123142:0:14064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008c06bda8/0x8c5345f1c1ec5f80 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240097.123151:0:14064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5c0030400 already unused, calling callback (ffffffffc1728ce0) 00010000:00010000:0.0:1782240097.123156:0:14064:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008c06bda8/0x8c5345f1c1ec5f80 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240097.123164:0:14064:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008c06bda8/0x8c5345f1c1ec5f80 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240097.123181:0:14064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008c06bda8/0x8c5345f1c1ec5f80 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240097.123188:0:14064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c06bda8/0x8c5345f1c1ec5f80 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240097.123208:0:14064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782240097.123210:0:14064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782240097.123212:0:14064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782240097.123682:0:14713:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782240097.123689:0:14713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dcaea82a/0x8c5345f1c1ec5f87 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240097.123699:0:14713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=476s v=(0 0) 00010000:00010000:0.0:1782240097.123702:0:14713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782240097.123707:0:14713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dcaea82a/0x8c5345f1c1ec5f87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240097.124125:0:14713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dcaea82a/0x8c5345f1c1ec5f87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240097.124135:0:14713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dcaea82a/0x8c5345f1c1ec5f87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240097.124143:0:14713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dcaea82a/0x8c5345f1c1ec5f87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.126811:0:14713:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1782240097.127530:0:14713:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782240097.127539:0:14713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9cd392c/0x8c5345f1c1ec5f8e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.127557:0:14713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=476s v=(0 0) 00010000:00010000:2.0:1782240097.127561:0:14713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782240097.127567:0:14713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a9cd392c/0x8c5345f1c1ec5f8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.127582:0:14713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a9cd392c/0x8c5345f1c1ec5f8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.127592:0:14713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9cd392c/0x8c5345f1c1ec5f8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.127781:0:14713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a9cd392c/0x8c5345f1c1ec5f8e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.127800:0:14713:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1782240097.128447:0:14713:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782240097.128454:0:14713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f4fd7be0/0x8c5345f1c1ec5f95 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.128465:0:14713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=476s v=(0 0) 00010000:00010000:2.0:1782240097.128468:0:14713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782240097.128473:0:14713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f4fd7be0/0x8c5345f1c1ec5f95 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.128496:0:14713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f4fd7be0/0x8c5345f1c1ec5f95 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.128506:0:14713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f4fd7be0/0x8c5345f1c1ec5f95 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.128512:0:14713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f4fd7be0/0x8c5345f1c1ec5f95 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.128520:0:14713:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1782240097.129906:0:14713:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782240097.129916:0:14713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084a1df51/0x8c5345f1c1ec5f9c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.129929:0:14713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=476s v=(0 0) 00010000:00010000:2.0:1782240097.129933:0:14713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782240097.129939:0:14713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000084a1df51/0x8c5345f1c1ec5f9c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240097.130942:0:14065:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1782240097.130952:0:14065:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dcaea82a/0x8c5345f1c1ec5f87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240097.130962:0:14065:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5c0031400 already unused, calling callback (ffffffffc1728ce0) 00010000:00010000:1.0:1782240097.130967:0:14065:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dcaea82a/0x8c5345f1c1ec5f87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240097.130977:0:14065:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dcaea82a/0x8c5345f1c1ec5f87 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240097.131011:0:14065:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dcaea82a/0x8c5345f1c1ec5f87 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240097.131019:0:14065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dcaea82a/0x8c5345f1c1ec5f87 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240097.131055:0:14065:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782240097.131061:0:14065:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a9cd392c/0x8c5345f1c1ec5f8e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240097.131069:0:14065:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5ee29fa00 already unused, calling callback (ffffffffc1728ce0) 00010000:00010000:1.0:1782240097.131073:0:14065:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9cd392c/0x8c5345f1c1ec5f8e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240097.131082:0:14065:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9cd392c/0x8c5345f1c1ec5f8e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240097.131093:0:14065:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a9cd392c/0x8c5345f1c1ec5f8e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240097.131100:0:14065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a9cd392c/0x8c5345f1c1ec5f8e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240097.131116:0:14065:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782240097.131120:0:14065:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f4fd7be0/0x8c5345f1c1ec5f95 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240097.131134:0:14065:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5ee29fc00 already unused, calling callback (ffffffffc1728ce0) 00010000:00010000:1.0:1782240097.131137:0:14065:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4fd7be0/0x8c5345f1c1ec5f95 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240097.131144:0:14065:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4fd7be0/0x8c5345f1c1ec5f95 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240097.131155:0:14065:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f4fd7be0/0x8c5345f1c1ec5f95 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240097.131162:0:14065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f4fd7be0/0x8c5345f1c1ec5f95 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240097.131175:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782240097.131178:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782240097.131180:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782240097.131275:0:14064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782240097.131324:0:14713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000084a1df51/0x8c5345f1c1ec5f9c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.131337:0:14713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084a1df51/0x8c5345f1c1ec5f9c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.131357:0:14713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000084a1df51/0x8c5345f1c1ec5f9c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.131381:0:14713:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782240097.131603:0:14065:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782240097.131609:0:14065:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000084a1df51/0x8c5345f1c1ec5f9c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240097.131617:0:14065:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5ee29e000 already unused, calling callback (ffffffffc1728ce0) 00010000:00010000:1.0:1782240097.131620:0:14065:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000084a1df51/0x8c5345f1c1ec5f9c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240097.131628:0:14065:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000084a1df51/0x8c5345f1c1ec5f9c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240097.131647:0:14065:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000084a1df51/0x8c5345f1c1ec5f9c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240097.131655:0:14065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000084a1df51/0x8c5345f1c1ec5f9c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240097.131680:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782240097.131682:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782240097.131684:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1782240097.131954:0:14713:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782240097.131963:0:14713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094b36f39/0x8c5345f1c1ec5fa3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.131975:0:14713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=476s v=(0 0) 00010000:00010000:2.0:1782240097.131979:0:14713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782240097.131985:0:14713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000094b36f39/0x8c5345f1c1ec5fa3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.131995:0:14713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000094b36f39/0x8c5345f1c1ec5fa3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.132004:0:14713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094b36f39/0x8c5345f1c1ec5fa3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.132012:0:14713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000094b36f39/0x8c5345f1c1ec5fa3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.132026:0:14713:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1782240097.132359:0:14713:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782240097.132365:0:14713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000064b46ef9/0x8c5345f1c1ec5faa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.132378:0:14713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=476s v=(0 0) 00010000:00010000:2.0:1782240097.132381:0:14713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782240097.132386:0:14713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000064b46ef9/0x8c5345f1c1ec5faa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.132395:0:14713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000064b46ef9/0x8c5345f1c1ec5faa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.132403:0:14713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000064b46ef9/0x8c5345f1c1ec5faa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.132410:0:14713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000064b46ef9/0x8c5345f1c1ec5faa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.132430:0:14713:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1782240097.132472:0:14065:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782240097.132478:0:14065:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000094b36f39/0x8c5345f1c1ec5fa3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240097.132490:0:14065:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5ee29e200 already unused, calling callback (ffffffffc1728ce0) 00010000:00010000:1.0:1782240097.132494:0:14065:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000094b36f39/0x8c5345f1c1ec5fa3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240097.132502:0:14065:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000094b36f39/0x8c5345f1c1ec5fa3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240097.132514:0:14065:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000094b36f39/0x8c5345f1c1ec5fa3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240097.132521:0:14065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000094b36f39/0x8c5345f1c1ec5fa3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240097.132550:0:14065:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782240097.132554:0:14065:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000064b46ef9/0x8c5345f1c1ec5faa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240097.132560:0:14065:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5ee29ec00 already unused, calling callback (ffffffffc1728ce0) 00010000:00010000:1.0:1782240097.132563:0:14065:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000064b46ef9/0x8c5345f1c1ec5faa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240097.132570:0:14065:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000064b46ef9/0x8c5345f1c1ec5faa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240097.132579:0:14065:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000064b46ef9/0x8c5345f1c1ec5faa lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240097.132586:0:14065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000064b46ef9/0x8c5345f1c1ec5faa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240097.132598:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782240097.132600:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782240097.132601:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1782240097.132841:0:14713:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782240097.132847:0:14713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000cddc306/0x8c5345f1c1ec5fb1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.132854:0:14713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=476s v=(0 0) 00010000:00010000:2.0:1782240097.132858:0:14713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782240097.132862:0:14713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000cddc306/0x8c5345f1c1ec5fb1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.132871:0:14713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000cddc306/0x8c5345f1c1ec5fb1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.132890:0:14713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000cddc306/0x8c5345f1c1ec5fb1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.132898:0:14713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000cddc306/0x8c5345f1c1ec5fb1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.132914:0:14713:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782240097.132922:0:14065:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782240097.132925:0:14065:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000cddc306/0x8c5345f1c1ec5fb1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.132933:0:14065:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5ee29e800 already unused, calling callback (ffffffffc1728ce0) 00010000:00010000:2.0:1782240097.132936:0:14065:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000cddc306/0x8c5345f1c1ec5fb1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.132944:0:14065:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000cddc306/0x8c5345f1c1ec5fb1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.132956:0:14065:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000cddc306/0x8c5345f1c1ec5fb1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.132963:0:14065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000cddc306/0x8c5345f1c1ec5fb1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.132976:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782240097.132983:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782240097.132985:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782240097.133384:0:14064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1782240097.133940:0:14713:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782240097.133948:0:14713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b672dedb/0x8c5345f1c1ec5fb8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.134150:0:14713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=476s v=(0 0) 00010000:00010000:2.0:1782240097.134154:0:14713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782240097.134159:0:14713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b672dedb/0x8c5345f1c1ec5fb8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.134170:0:14713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b672dedb/0x8c5345f1c1ec5fb8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.134180:0:14713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b672dedb/0x8c5345f1c1ec5fb8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.134188:0:14713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b672dedb/0x8c5345f1c1ec5fb8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.134204:0:14713:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782240097.134214:0:14065:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782240097.134218:0:14065:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b672dedb/0x8c5345f1c1ec5fb8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.134224:0:14065:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5ee29f800 already unused, calling callback (ffffffffc1728ce0) 00010000:00010000:2.0:1782240097.134228:0:14065:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b672dedb/0x8c5345f1c1ec5fb8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.134256:0:14065:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b672dedb/0x8c5345f1c1ec5fb8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.134270:0:14065:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b672dedb/0x8c5345f1c1ec5fb8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.134278:0:14065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b672dedb/0x8c5345f1c1ec5fb8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.134291:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782240097.134293:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782240097.134294:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1782240097.134679:0:14713:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782240097.134685:0:14713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000375f2b56/0x8c5345f1c1ec5fbf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.134693:0:14713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=476s v=(0 0) 00010000:00010000:2.0:1782240097.134696:0:14713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782240097.134700:0:14713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000375f2b56/0x8c5345f1c1ec5fbf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.134721:0:14713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000375f2b56/0x8c5345f1c1ec5fbf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.134728:0:14713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000375f2b56/0x8c5345f1c1ec5fbf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.134742:0:14713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000375f2b56/0x8c5345f1c1ec5fbf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.134771:0:14713:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1782240097.135237:0:14713:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782240097.135242:0:14713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3b97cf7/0x8c5345f1c1ec5fc6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.135250:0:14713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=476s v=(0 0) 00010000:00010000:2.0:1782240097.135253:0:14713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782240097.135256:0:14713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3b97cf7/0x8c5345f1c1ec5fc6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.135264:0:14713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b3b97cf7/0x8c5345f1c1ec5fc6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.135271:0:14713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3b97cf7/0x8c5345f1c1ec5fc6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.135277:0:14713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b3b97cf7/0x8c5345f1c1ec5fc6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.135291:0:14713:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1782240097.135301:0:14065:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782240097.135306:0:14065:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000375f2b56/0x8c5345f1c1ec5fbf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.135319:0:14065:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb4c2018a00 already unused, calling callback (ffffffffc1728ce0) 00010000:00010000:2.0:1782240097.135323:0:14065:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000375f2b56/0x8c5345f1c1ec5fbf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.135331:0:14065:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000375f2b56/0x8c5345f1c1ec5fbf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.135349:0:14065:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000375f2b56/0x8c5345f1c1ec5fbf lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.135356:0:14065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000375f2b56/0x8c5345f1c1ec5fbf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.135371:0:14065:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782240097.135374:0:14065:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b3b97cf7/0x8c5345f1c1ec5fc6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.135379:0:14065:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb4c2019a00 already unused, calling callback (ffffffffc1728ce0) 00010000:00010000:2.0:1782240097.135382:0:14065:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3b97cf7/0x8c5345f1c1ec5fc6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.135447:0:14065:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3b97cf7/0x8c5345f1c1ec5fc6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.135457:0:14065:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b3b97cf7/0x8c5345f1c1ec5fc6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.135470:0:14065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b3b97cf7/0x8c5345f1c1ec5fc6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.135483:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782240097.135484:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782240097.135486:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1782240097.136209:0:14713:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782240097.136217:0:14713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a7c1c8c/0x8c5345f1c1ec5fcd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.136226:0:14713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=476s v=(0 0) 00010000:00010000:2.0:1782240097.136229:0:14713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782240097.136292:0:14713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a7c1c8c/0x8c5345f1c1ec5fcd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.136303:0:14713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000a7c1c8c/0x8c5345f1c1ec5fcd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.136311:0:14713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a7c1c8c/0x8c5345f1c1ec5fcd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.136318:0:14713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000a7c1c8c/0x8c5345f1c1ec5fcd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.136334:0:14713:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782240097.136343:0:14065:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782240097.136353:0:14065:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000a7c1c8c/0x8c5345f1c1ec5fcd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.136360:0:14065:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb4c2019600 already unused, calling callback (ffffffffc1728ce0) 00010000:00010000:2.0:1782240097.136363:0:14065:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000a7c1c8c/0x8c5345f1c1ec5fcd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.136369:0:14065:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000a7c1c8c/0x8c5345f1c1ec5fcd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.136381:0:14065:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000a7c1c8c/0x8c5345f1c1ec5fcd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.136387:0:14065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a7c1c8c/0x8c5345f1c1ec5fcd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.136400:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782240097.136402:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782240097.136665:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1782240097.137383:0:14713:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782240097.137391:0:14713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036eca12a/0x8c5345f1c1ec5fd4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.137403:0:14713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=476s v=(0 0) 00010000:00010000:2.0:1782240097.137407:0:14713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782240097.137412:0:14713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000036eca12a/0x8c5345f1c1ec5fd4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.137432:0:14713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000036eca12a/0x8c5345f1c1ec5fd4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.137441:0:14713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036eca12a/0x8c5345f1c1ec5fd4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.137450:0:14713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000036eca12a/0x8c5345f1c1ec5fd4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.137466:0:14713:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782240097.137476:0:14065:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782240097.137480:0:14065:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000036eca12a/0x8c5345f1c1ec5fd4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.137486:0:14065:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb4c2018c00 already unused, calling callback (ffffffffc1728ce0) 00010000:00010000:2.0:1782240097.137490:0:14065:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000036eca12a/0x8c5345f1c1ec5fd4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.137498:0:14065:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000036eca12a/0x8c5345f1c1ec5fd4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.137510:0:14065:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000036eca12a/0x8c5345f1c1ec5fd4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.137518:0:14065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000036eca12a/0x8c5345f1c1ec5fd4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.137540:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782240097.137541:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782240097.137543:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782240097.137704:0:14064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1782240097.138582:0:14713:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782240097.138591:0:14713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b3e8d2b/0x8c5345f1c1ec5fdb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.139050:0:14713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=476s v=(0 0) 00010000:00010000:2.0:1782240097.139054:0:14713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782240097.139061:0:14713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b3e8d2b/0x8c5345f1c1ec5fdb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.139073:0:14713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b3e8d2b/0x8c5345f1c1ec5fdb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.139082:0:14713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b3e8d2b/0x8c5345f1c1ec5fdb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.139089:0:14713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009b3e8d2b/0x8c5345f1c1ec5fdb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.139132:0:14713:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782240097.139180:0:14065:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782240097.139188:0:14065:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009b3e8d2b/0x8c5345f1c1ec5fdb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240097.139197:0:14065:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb4c2019800 already unused, calling callback (ffffffffc1728ce0) 00010000:00010000:0.0:1782240097.139202:0:14065:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009b3e8d2b/0x8c5345f1c1ec5fdb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240097.139212:0:14065:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009b3e8d2b/0x8c5345f1c1ec5fdb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240097.139228:0:14065:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009b3e8d2b/0x8c5345f1c1ec5fdb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240097.139248:0:14065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b3e8d2b/0x8c5345f1c1ec5fdb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240097.139270:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782240097.139272:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782240097.139274:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1782240097.140622:0:14713:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782240097.140634:0:14713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d507f442/0x8c5345f1c1ec5fe2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.140658:0:14713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=476s v=(0 0) 00010000:00010000:2.0:1782240097.140662:0:14713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782240097.140669:0:14713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d507f442/0x8c5345f1c1ec5fe2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.140681:0:14713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d507f442/0x8c5345f1c1ec5fe2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.140690:0:14713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d507f442/0x8c5345f1c1ec5fe2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.140699:0:14713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d507f442/0x8c5345f1c1ec5fe2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.140722:0:14713:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782240097.140824:0:14064:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782240097.140831:0:14064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d507f442/0x8c5345f1c1ec5fe2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240097.140849:0:14064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb4c2019200 already unused, calling callback (ffffffffc1728ce0) 00010000:00010000:0.0:1782240097.140854:0:14064:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d507f442/0x8c5345f1c1ec5fe2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240097.140863:0:14064:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d507f442/0x8c5345f1c1ec5fe2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240097.140879:0:14064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d507f442/0x8c5345f1c1ec5fe2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240097.140886:0:14064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d507f442/0x8c5345f1c1ec5fe2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240097.140906:0:14064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782240097.140908:0:14064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782240097.140910:0:14064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1782240097.142416:0:14713:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782240097.142427:0:14713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000459d7df8/0x8c5345f1c1ec5fe9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.142442:0:14713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=476s v=(0 0) 00010000:00010000:2.0:1782240097.142445:0:14713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782240097.142451:0:14713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000459d7df8/0x8c5345f1c1ec5fe9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.142461:0:14713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000459d7df8/0x8c5345f1c1ec5fe9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.142481:0:14713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000459d7df8/0x8c5345f1c1ec5fe9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.142488:0:14713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000459d7df8/0x8c5345f1c1ec5fe9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.142508:0:14713:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1782240097.142921:0:14713:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782240097.142928:0:14713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046037bcf/0x8c5345f1c1ec5ff0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.142938:0:14713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=476s v=(0 0) 00010000:00010000:2.0:1782240097.142941:0:14713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782240097.142946:0:14713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046037bcf/0x8c5345f1c1ec5ff0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.142955:0:14713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000046037bcf/0x8c5345f1c1ec5ff0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.142963:0:14713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046037bcf/0x8c5345f1c1ec5ff0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.142970:0:14713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000046037bcf/0x8c5345f1c1ec5ff0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.142992:0:14713:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1782240097.143410:0:14713:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782240097.143416:0:14713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002863ad5c/0x8c5345f1c1ec5ff7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.143424:0:14713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=476s v=(0 0) 00010000:00010000:2.0:1782240097.143427:0:14713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782240097.143432:0:14713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002863ad5c/0x8c5345f1c1ec5ff7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.143441:0:14713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002863ad5c/0x8c5345f1c1ec5ff7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.143449:0:14713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002863ad5c/0x8c5345f1c1ec5ff7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.143456:0:14713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002863ad5c/0x8c5345f1c1ec5ff7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.143465:0:14713:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1782240097.143679:0:14065:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1782240097.143688:0:14065:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000459d7df8/0x8c5345f1c1ec5fe9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240097.143698:0:14065:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb4c2019000 already unused, calling callback (ffffffffc1728ce0) 00010000:00010000:0.0:1782240097.143703:0:14065:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000459d7df8/0x8c5345f1c1ec5fe9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240097.143713:0:14065:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000459d7df8/0x8c5345f1c1ec5fe9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240097.143741:0:14065:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000459d7df8/0x8c5345f1c1ec5fe9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240097.143772:0:14065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000459d7df8/0x8c5345f1c1ec5fe9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240097.143795:0:14065:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782240097.143799:0:14065:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000046037bcf/0x8c5345f1c1ec5ff0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240097.143806:0:14065:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb4c2018200 already unused, calling callback (ffffffffc1728ce0) 00010000:00010000:0.0:1782240097.143811:0:14065:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000046037bcf/0x8c5345f1c1ec5ff0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240097.143819:0:14065:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000046037bcf/0x8c5345f1c1ec5ff0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240097.143843:0:14065:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000046037bcf/0x8c5345f1c1ec5ff0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240097.143851:0:14065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000046037bcf/0x8c5345f1c1ec5ff0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240097.143867:0:14065:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782240097.143870:0:14065:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002863ad5c/0x8c5345f1c1ec5ff7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240097.143878:0:14065:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb4c2018600 already unused, calling callback (ffffffffc1728ce0) 00010000:00010000:0.0:1782240097.143882:0:14065:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002863ad5c/0x8c5345f1c1ec5ff7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240097.143890:0:14065:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002863ad5c/0x8c5345f1c1ec5ff7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782240097.143897:0:14713:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782240097.143900:0:14065:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002863ad5c/0x8c5345f1c1ec5ff7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.143904:0:14713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084c5f299/0x8c5345f1c1ec5ffe lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240097.143914:0:14065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002863ad5c/0x8c5345f1c1ec5ff7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.143918:0:14713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=476s v=(0 0) 00010000:00010000:2.0:1782240097.143928:0:14713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782240097.143929:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782240097.143932:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782240097.143934:0:14713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000084c5f299/0x8c5345f1c1ec5ffe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240097.143942:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782240097.143948:0:14713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000084c5f299/0x8c5345f1c1ec5ffe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240097.143950:0:14064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782240097.143960:0:14713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084c5f299/0x8c5345f1c1ec5ffe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.143967:0:14713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000084c5f299/0x8c5345f1c1ec5ffe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.143986:0:14713:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782240097.144066:0:14065:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782240097.144071:0:14065:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000084c5f299/0x8c5345f1c1ec5ffe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240097.144079:0:14065:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb4c2019c00 already unused, calling callback (ffffffffc1728ce0) 00010000:00010000:0.0:1782240097.144082:0:14065:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000084c5f299/0x8c5345f1c1ec5ffe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240097.144089:0:14065:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000084c5f299/0x8c5345f1c1ec5ffe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240097.144101:0:14065:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000084c5f299/0x8c5345f1c1ec5ffe lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240097.144109:0:14065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000084c5f299/0x8c5345f1c1ec5ffe lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240097.144123:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782240097.144125:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782240097.144126:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1782240097.146197:0:14713:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782240097.146208:0:14713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036eca12a/0x8c5345f1c1ec6005 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.146223:0:14713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=476s v=(0 0) 00010000:00010000:2.0:1782240097.146227:0:14713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782240097.146232:0:14713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000036eca12a/0x8c5345f1c1ec6005 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782240097.147607:0:5812:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:2.0:1782240097.148347:0:14713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000036eca12a/0x8c5345f1c1ec6005 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.148361:0:14713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036eca12a/0x8c5345f1c1ec6005 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.148376:0:14713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000036eca12a/0x8c5345f1c1ec6005 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.148407:0:14713:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1782240097.149216:0:14713:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782240097.149224:0:14713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a7c1c8c/0x8c5345f1c1ec600c lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.149305:0:14713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=476s v=(0 0) 00010000:00010000:2.0:1782240097.149310:0:14713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782240097.149316:0:14713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a7c1c8c/0x8c5345f1c1ec600c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.149328:0:14713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000a7c1c8c/0x8c5345f1c1ec600c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.149336:0:14713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a7c1c8c/0x8c5345f1c1ec600c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.149342:0:14713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000a7c1c8c/0x8c5345f1c1ec600c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.149357:0:14713:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1782240097.150224:0:14713:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782240097.150233:0:14713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3b97cf7/0x8c5345f1c1ec6013 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240097.150720:0:14064:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782240097.150728:0:14064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000036eca12a/0x8c5345f1c1ec6005 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240097.150739:0:14064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb4c2018c00 already unused, calling callback (ffffffffc1728ce0) 00010000:00010000:0.0:1782240097.150744:0:14064:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000036eca12a/0x8c5345f1c1ec6005 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240097.150774:0:14064:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000036eca12a/0x8c5345f1c1ec6005 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240097.150792:0:14064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000036eca12a/0x8c5345f1c1ec6005 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240097.150800:0:14064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000036eca12a/0x8c5345f1c1ec6005 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240097.150821:0:14064:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782240097.150825:0:14064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000a7c1c8c/0x8c5345f1c1ec600c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240097.150831:0:14064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb4c2019600 already unused, calling callback (ffffffffc1728ce0) 00010000:00010000:0.0:1782240097.150834:0:14064:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000a7c1c8c/0x8c5345f1c1ec600c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240097.150841:0:14064:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000a7c1c8c/0x8c5345f1c1ec600c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240097.150850:0:14064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000a7c1c8c/0x8c5345f1c1ec600c lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240097.150856:0:14064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a7c1c8c/0x8c5345f1c1ec600c lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240097.150876:0:14064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782240097.150878:0:14064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782240097.150880:0:14064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782240097.150941:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782240097.151393:0:14713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=476s v=(0 0) 00010000:00010000:2.0:1782240097.151398:0:14713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782240097.151405:0:14713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3b97cf7/0x8c5345f1c1ec6013 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.151418:0:14713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b3b97cf7/0x8c5345f1c1ec6013 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.151427:0:14713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3b97cf7/0x8c5345f1c1ec6013 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.151436:0:14713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b3b97cf7/0x8c5345f1c1ec6013 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.151495:0:14713:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1782240097.152114:0:14713:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782240097.152122:0:14713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000375f2b56/0x8c5345f1c1ec601a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.152132:0:14713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=476s v=(0 0) 00010000:00010000:2.0:1782240097.152136:0:14713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782240097.152140:0:14713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000375f2b56/0x8c5345f1c1ec601a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.152150:0:14713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000375f2b56/0x8c5345f1c1ec601a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.152171:0:14713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000375f2b56/0x8c5345f1c1ec601a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.152179:0:14713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000375f2b56/0x8c5345f1c1ec601a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240097.155794:0:14064:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782240097.155807:0:14064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b3b97cf7/0x8c5345f1c1ec6013 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240097.155823:0:14064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb4c2019a00 already unused, calling callback (ffffffffc1728ce0) 00010000:00010000:0.0:1782240097.155827:0:14064:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3b97cf7/0x8c5345f1c1ec6013 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240097.155838:0:14064:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3b97cf7/0x8c5345f1c1ec6013 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240097.155860:0:14064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b3b97cf7/0x8c5345f1c1ec6013 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240097.155868:0:14064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b3b97cf7/0x8c5345f1c1ec6013 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240097.157449:0:14064:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782240097.157460:0:14064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000375f2b56/0x8c5345f1c1ec601a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240097.157486:0:14064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb4c2018a00 already unused, calling callback (ffffffffc1728ce0) 00010000:00010000:1.0:1782240097.157491:0:14064:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000375f2b56/0x8c5345f1c1ec601a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240097.157502:0:14064:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000375f2b56/0x8c5345f1c1ec601a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240097.157519:0:14064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000375f2b56/0x8c5345f1c1ec601a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240097.157529:0:14064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782240097.157531:0:14064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782240097.157533:0:14064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782240097.157690:0:14713:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1782240097.157699:0:14713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000375f2b56/0x8c5345f1c1ec601a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782240097.158464:0:14713:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782240097.158473:0:14713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056c61ab1/0x8c5345f1c1ec6021 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.158485:0:14713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=476s v=(0 0) 00010000:00010000:2.0:1782240097.158489:0:14713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782240097.158496:0:14713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000056c61ab1/0x8c5345f1c1ec6021 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.158508:0:14713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000056c61ab1/0x8c5345f1c1ec6021 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.158519:0:14713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056c61ab1/0x8c5345f1c1ec6021 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.158539:0:14713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000056c61ab1/0x8c5345f1c1ec6021 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.158563:0:14713:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782240097.158576:0:14064:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782240097.158581:0:14064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000056c61ab1/0x8c5345f1c1ec6021 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.158587:0:14064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb4c2019400 already unused, calling callback (ffffffffc1728ce0) 00010000:00010000:2.0:1782240097.158591:0:14064:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000056c61ab1/0x8c5345f1c1ec6021 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.158598:0:14064:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000056c61ab1/0x8c5345f1c1ec6021 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.158611:0:14064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000056c61ab1/0x8c5345f1c1ec6021 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.158617:0:14064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000056c61ab1/0x8c5345f1c1ec6021 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.158631:0:14064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782240097.158632:0:14064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782240097.158634:0:14064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782240097.159159:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1782240097.159259:0:14713:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782240097.159275:0:14713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062ea54a2/0x8c5345f1c1ec6028 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.159285:0:14713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=476s v=(0 0) 00010000:00010000:2.0:1782240097.159289:0:14713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782240097.159294:0:14713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062ea54a2/0x8c5345f1c1ec6028 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.159304:0:14713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000062ea54a2/0x8c5345f1c1ec6028 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.159314:0:14713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062ea54a2/0x8c5345f1c1ec6028 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.159321:0:14713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000062ea54a2/0x8c5345f1c1ec6028 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.159344:0:14713:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1782240097.159729:0:14713:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782240097.159735:0:14713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000454604fc/0x8c5345f1c1ec602f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.159743:0:14713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=476s v=(0 0) 00010000:00010000:2.0:1782240097.159776:0:14713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782240097.159780:0:14713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000454604fc/0x8c5345f1c1ec602f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.159789:0:14713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000454604fc/0x8c5345f1c1ec602f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.159803:0:14713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000454604fc/0x8c5345f1c1ec602f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.159809:0:14713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000454604fc/0x8c5345f1c1ec602f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240097.159820:0:14713:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00080000:2.0:1782240097.159969:0:14713:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:2.0:1782240097.160090:0:14713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f77a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14101:x1868813758994816:12345-0@lo:5:osp-pre-1-0.0 Request processed in 94501us (94597us total) trans 0 rc 0/0 00000100:00100000:2.0:1782240097.160103:0:14713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1782240097.160167:0:14101:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f77a7800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14101:1868813758994816:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1782240097.160183:0:14101:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:2.0:1782240097.160233:0:14101:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fbe08e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14101:1868813758994944:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1782240097.160267:0:14101:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782240097.160303:0:14101:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb601a1c6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782240097.160317:0:14714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758994944 00000100:00100000:2.0:1782240097.160323:0:14714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758994944 00000100:00100000:2.0:1782240097.160353:0:14714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1782240097.160360:0:14714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fbe09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14101:x1868813758994944:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1782240097.160393:0:14714:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00010000:00010000:1.0:1782240097.161214:0:14065:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782240097.161222:0:14065:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000062ea54a2/0x8c5345f1c1ec6028 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240097.161244:0:14065:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb4c2019e00 already unused, calling callback (ffffffffc1728ce0) 00010000:00010000:1.0:1782240097.161249:0:14065:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000062ea54a2/0x8c5345f1c1ec6028 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240097.161259:0:14065:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000062ea54a2/0x8c5345f1c1ec6028 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240097.161277:0:14065:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000062ea54a2/0x8c5345f1c1ec6028 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240097.161293:0:14065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000062ea54a2/0x8c5345f1c1ec6028 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240097.161314:0:14065:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782240097.161318:0:14065:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000454604fc/0x8c5345f1c1ec602f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240097.161324:0:14065:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb4c2018000 already unused, calling callback (ffffffffc1728ce0) 00010000:00010000:1.0:1782240097.161328:0:14065:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000454604fc/0x8c5345f1c1ec602f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240097.161335:0:14065:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000454604fc/0x8c5345f1c1ec602f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240097.161345:0:14065:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000454604fc/0x8c5345f1c1ec602f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240097.161352:0:14065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000454604fc/0x8c5345f1c1ec602f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240097.161363:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782240097.161365:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782240097.161366:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782240097.161372:0:14064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782240097.168852:0:14714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fbe09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14101:x1868813758994944:12345-0@lo:5:osp-pre-1-0.0 Request processed in 8485us (8578us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1782240097.168864:0:14714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1782240097.169098:0:14101:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fbe08e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14101:1868813758994944:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1782240097.169121:0:14101:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:0.0:1782240097.765192:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1782240098.557671:0:15735:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg332-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1782240098.791548:0:14064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782240099.807881:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782240100.643846:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f4895500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813758995072:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782240100.643914:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782240100.644103:0:14716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758995072 00000100:00100000:1.0:1782240100.644112:0:14716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758995072 00000100:00100000:1.0:1782240100.644167:0:14716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782240100.644177:0:14716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc2a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1868813758995072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782240100.644212:0:14716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782240100.644255:0:14716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc2a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1868813758995072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1782240100.644262:0:14716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1782240100.644281:0:14072:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782240100.644315:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f4895500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813758995072:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1782240100.834571:0:14064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782240100.921445:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782240100.921543:0:14071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738025728 00000100:00100000:2.0:1782240100.921553:0:14071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738025728 00000100:00100000:2.0:1782240100.921602:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 75 00000100:00100000:2.0:1782240100.921610:0:14071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2343:x1868813738025728:12345-192.168.203.32@tcp:250:mount.lustre.0 00010000:00080000:2.0:1782240100.921637:0:14071:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 94a0379e-2f28-4d53-90a1-f8718289b741@192.168.203.32@tcp t0 exp 0000000000000000 cur 479 last 0 00000020:00000080:2.0:1782240100.921667:0:14071:0:(genops.c:1406:class_connect()) connect: client 94a0379e-2f28-4d53-90a1-f8718289b741, cookie 0x8c5345f1c1ec6036 00000100:00080000:2.0:1782240100.921845:0:14071:0:(import.c:65:import_set_state_nolock()) ffff9bb5ee77a800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782240100.921928:0:14071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94a0379e-2f28-4d53-90a1-f8718289b741+5:2343:x1868813738025728:12345-192.168.203.32@tcp:250:mount.lustre.0 Request processed in 315us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1782240100.921936:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 75 00000100:00100000:3.0:1782240100.928512:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782240100.932225:0:14068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738025856 00000100:00100000:1.0:1782240100.932240:0:14068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738025856 00000100:00100000:1.0:1782240100.932394:0:14068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 76 00000100:00100000:1.0:1782240100.932406:0:14068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94a0379e-2f28-4d53-90a1-f8718289b741+5:13694:x1868813738025856:12345-192.168.203.32@tcp:101:mount.lustre.0 00010000:00010000:1.0:1782240100.932423:0:14068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782240100.932440:0:14068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb5f7e38000/0x8c5345f1c1ec603d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e866 expref: -99 pid: 14068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240100.932466:0:14068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb5f7e38000/0x8c5345f1c1ec603d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e866 expref: 6 pid: 14068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240100.932494:0:14068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb5f7e38000/0x8c5345f1c1ec603d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e866 expref: 6 pid: 14068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240100.932502:0:14068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5f7e38000, rc 0) 00000100:00100000:1.0:1782240100.932566:0:14068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94a0379e-2f28-4d53-90a1-f8718289b741+6:13694:x1868813738025856:12345-192.168.203.32@tcp:101:mount.lustre.0 Request processed in 162us (4063us total) trans 0 rc 0/0 00000100:00100000:1.0:1782240100.932573:0:14068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 76 00000100:00100000:3.0:1782240100.947719:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782240100.948526:0:14070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738025984 00000100:00100000:1.0:1782240100.948537:0:14070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738025984 00000100:00100000:1.0:1782240100.948596:0:14070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 77 00000100:00100000:1.0:1782240100.948607:0:14070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94a0379e-2f28-4d53-90a1-f8718289b741+6:13694:x1868813738025984:12345-192.168.203.32@tcp:501:mount.lustre.0 00000100:00100000:1.0:1782240100.949055:0:14070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94a0379e-2f28-4d53-90a1-f8718289b741+6:13694:x1868813738025984:12345-192.168.203.32@tcp:501:mount.lustre.0 Request processed in 447us (1342us total) trans 0 rc -2/-2 00000100:00100000:1.0:1782240100.949065:0:14070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 77 00000100:00100000:3.0:1782240100.959818:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782240100.960651:0:14068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738026112 00000100:00100000:1.0:1782240100.960662:0:14068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738026112 00000100:00100000:1.0:1782240100.960710:0:14068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 78 00000100:00100000:1.0:1782240100.960718:0:14068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94a0379e-2f28-4d53-90a1-f8718289b741+6:13694:x1868813738026112:12345-192.168.203.32@tcp:101:mount.lustre.0 00010000:00010000:1.0:1782240100.960735:0:14068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782240100.960881:0:14068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb5f7e39400/0x8c5345f1c1ec6044 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e86d expref: -99 pid: 14068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240100.960915:0:14068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb5f7e39400/0x8c5345f1c1ec6044 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e86d expref: 7 pid: 14068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240100.960925:0:14068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb5f7e39400/0x8c5345f1c1ec6044 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e86d expref: 7 pid: 14068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240100.960946:0:14068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5f7e39400, rc 0) 00000100:00100000:1.0:1782240100.961008:0:14068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94a0379e-2f28-4d53-90a1-f8718289b741+7:13694:x1868813738026112:12345-192.168.203.32@tcp:101:mount.lustre.0 Request processed in 290us (1198us total) trans 0 rc 0/0 00000100:00100000:1.0:1782240100.961024:0:14068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 78 00000100:00100000:3.0:1782240100.963741:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782240100.963894:0:14071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738026240 00000100:00100000:2.0:1782240100.963904:0:14071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738026240 00000100:00100000:2.0:1782240100.963952:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 79 00000100:00100000:2.0:1782240100.963961:0:14071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94a0379e-2f28-4d53-90a1-f8718289b741+7:13694:x1868813738026240:12345-192.168.203.32@tcp:501:mount.lustre.0 00000100:00100000:2.0:1782240100.964275:0:14071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94a0379e-2f28-4d53-90a1-f8718289b741+8:13694:x1868813738026240:12345-192.168.203.32@tcp:501:mount.lustre.0 Request processed in 313us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1782240100.964284:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 79 00000100:00100000:3.0:1782240100.968685:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782240100.973365:0:14068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738026368 00000100:00100000:1.0:1782240100.973380:0:14068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738026368 00000100:00100000:1.0:1782240100.973450:0:14068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 80 00000100:00100000:1.0:1782240100.973460:0:14068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f39b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94a0379e-2f28-4d53-90a1-f8718289b741+8:13694:x1868813738026368:12345-192.168.203.32@tcp:503:mount.lustre.0 00000100:00100000:1.0:1782240100.973811:0:14068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f39b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94a0379e-2f28-4d53-90a1-f8718289b741+8:13694:x1868813738026368:12345-192.168.203.32@tcp:503:mount.lustre.0 Request processed in 351us (5133us total) trans 0 rc 0/0 00000100:00100000:1.0:1782240100.973821:0:14068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 80 00000100:00100000:3.0:1782240100.982902:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782240100.983405:0:14070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738026496 00000100:00100000:0.0:1782240100.983416:0:14070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738026496 00000100:00100000:0.0:1782240100.983477:0:14070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 81 00000100:00100000:0.0:1782240100.983486:0:14070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f39b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94a0379e-2f28-4d53-90a1-f8718289b741+8:13713:x1868813738026496:12345-192.168.203.32@tcp:502:llog_process_th.0 00000100:00100000:0.0:1782240100.984554:0:14070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f39b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94a0379e-2f28-4d53-90a1-f8718289b741+8:13713:x1868813738026496:12345-192.168.203.32@tcp:502:llog_process_th.0 Request processed in 1064us (1657us total) trans 0 rc 0/0 00000100:00100000:0.0:1782240100.984565:0:14070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 81 00000100:00100000:2.0:1782240101.006892:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782240101.006997:0:14068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738026624 00000100:00100000:1.0:1782240101.007008:0:14068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738026624 00000100:00100000:1.0:1782240101.007069:0:14068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 82 00000100:00100000:1.0:1782240101.007088:0:14068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f39b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94a0379e-2f28-4d53-90a1-f8718289b741+8:13713:x1868813738026624:12345-192.168.203.32@tcp:502:llog_process_th.0 00000100:00100000:1.0:1782240101.007368:0:14068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f39b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94a0379e-2f28-4d53-90a1-f8718289b741+8:13713:x1868813738026624:12345-192.168.203.32@tcp:502:llog_process_th.0 Request processed in 290us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1782240101.007377:0:14068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 82 00000100:00100000:3.0:1782240101.028288:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782240101.029950:0:14070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738026752 00000100:00100000:0.0:1782240101.029965:0:14070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738026752 00000100:00100000:0.0:1782240101.030080:0:14070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 83 00000100:00100000:0.0:1782240101.030092:0:14070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f39bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94a0379e-2f28-4d53-90a1-f8718289b741+8:13694:x1868813738026752:12345-192.168.203.32@tcp:101:mount.lustre.0 00010000:00010000:0.0:1782240101.030266:0:14070:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782240101.030284:0:14070:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb5c0030c00/0x8c5345f1c1ec604b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e897 expref: -99 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240101.030567:0:14070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb5c0030c00/0x8c5345f1c1ec604b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e897 expref: 9 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240101.030579:0:14070:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb5c0030c00/0x8c5345f1c1ec604b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e897 expref: 9 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240101.030588:0:14070:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5c0030c00, rc 0) 00000100:00100000:0.0:1782240101.030712:0:14070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f39bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94a0379e-2f28-4d53-90a1-f8718289b741+9:13694:x1868813738026752:12345-192.168.203.32@tcp:101:mount.lustre.0 Request processed in 622us (2432us total) trans 0 rc 0/0 00000100:00100000:0.0:1782240101.030720:0:14070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 83 00000100:00100000:3.0:1782240101.054204:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782240101.055011:0:14071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738026880 00000100:00100000:2.0:1782240101.055049:0:14071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738026880 00000100:00100000:2.0:1782240101.055109:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 84 00000100:00100000:2.0:1782240101.055119:0:14071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f39b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94a0379e-2f28-4d53-90a1-f8718289b741+9:13694:x1868813738026880:12345-192.168.203.32@tcp:256:mount.lustre.0 20000000:01000000:2.0:1782240101.055147:0:14071:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1782240101.055172:0:14071:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1782240101.055176:0:14071:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1782240101.055183:0:14071:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1782240101.055185:0:14071:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:3.0:1782240101.064072:0:14071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f39b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94a0379e-2f28-4d53-90a1-f8718289b741+9:13694:x1868813738026880:12345-192.168.203.32@tcp:256:mount.lustre.0 Request processed in 8941us (9864us total) trans 0 rc 0/0 00000100:00100000:3.0:1782240101.064090:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 84 00000100:00100000:3.0:1782240101.075862:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782240101.076024:0:14070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738027008 00000100:00100000:0.0:1782240101.076034:0:14070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738027008 00000100:00100000:0.0:1782240101.076092:0:14070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 85 00000100:00100000:0.0:1782240101.076101:0:14070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f39b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94a0379e-2f28-4d53-90a1-f8718289b741+9:13694:x1868813738027008:12345-192.168.203.32@tcp:101:mount.lustre.0 00010000:00010000:0.0:1782240101.076242:0:14070:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782240101.076271:0:14070:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb5c0031a00/0x8c5345f1c1ec6052 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e89e expref: -99 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240101.076366:0:14070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb5c0031a00/0x8c5345f1c1ec6052 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e89e expref: 10 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240101.076376:0:14070:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb5c0031a00/0x8c5345f1c1ec6052 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e89e expref: 10 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240101.076776:0:14070:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5c0031a00, rc 0) 00000100:00100000:0.0:1782240101.076957:0:14070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f39b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94a0379e-2f28-4d53-90a1-f8718289b741+10:13694:x1868813738027008:12345-192.168.203.32@tcp:101:mount.lustre.0 Request processed in 856us (1104us total) trans 0 rc 0/0 00000100:00100000:0.0:1782240101.076965:0:14070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 85 00000100:00100000:0.0:1782240101.083730:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782240101.084657:0:14071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738027136 00000100:00100000:3.0:1782240101.084668:0:14071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738027136 00000100:00100000:3.0:1782240101.084722:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 86 00000100:00100000:3.0:1782240101.084731:0:14071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f39bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94a0379e-2f28-4d53-90a1-f8718289b741+10:13694:x1868813738027136:12345-192.168.203.32@tcp:501:mount.lustre.0 00000100:00100000:3.0:1782240101.085034:0:14071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f39bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94a0379e-2f28-4d53-90a1-f8718289b741+10:13694:x1868813738027136:12345-192.168.203.32@tcp:501:mount.lustre.0 Request processed in 303us (1310us total) trans 0 rc 0/0 00000100:00100000:3.0:1782240101.085047:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 86 00000100:00100000:2.0:1782240101.088867:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782240101.088950:0:14070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738027264 00000100:00100000:0.0:1782240101.088959:0:14070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738027264 00000100:00100000:0.0:1782240101.089007:0:14070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 87 00000100:00100000:0.0:1782240101.089024:0:14070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f39b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94a0379e-2f28-4d53-90a1-f8718289b741+10:13694:x1868813738027264:12345-192.168.203.32@tcp:503:mount.lustre.0 00000100:00100000:0.0:1782240101.089727:0:14070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f39b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94a0379e-2f28-4d53-90a1-f8718289b741+10:13694:x1868813738027264:12345-192.168.203.32@tcp:503:mount.lustre.0 Request processed in 708us (864us total) trans 0 rc 0/0 00000100:00100000:0.0:1782240101.089736:0:14070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 87 00000100:00100000:2.0:1782240101.095730:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782240101.095853:0:14068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738027392 00000100:00100000:1.0:1782240101.095863:0:14068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738027392 00000100:00100000:1.0:1782240101.095910:0:14068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 88 00000100:00100000:1.0:1782240101.095919:0:14068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f39ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94a0379e-2f28-4d53-90a1-f8718289b741+10:13718:x1868813738027392:12345-192.168.203.32@tcp:502:llog_process_th.0 00000100:00100000:1.0:1782240101.096220:0:14068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f39ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94a0379e-2f28-4d53-90a1-f8718289b741+10:13718:x1868813738027392:12345-192.168.203.32@tcp:502:llog_process_th.0 Request processed in 301us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1782240101.096241:0:14068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 88 00000100:00100000:1.0:1782240101.114740:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782240101.116215:0:14070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738027520 00000100:00100000:0.0:1782240101.116229:0:14070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738027520 00000100:00100000:0.0:1782240101.116346:0:14070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 89 00000100:00100000:0.0:1782240101.116356:0:14070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f39b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94a0379e-2f28-4d53-90a1-f8718289b741+10:13718:x1868813738027520:12345-192.168.203.32@tcp:502:llog_process_th.0 00000100:00100000:0.0:1782240101.116616:0:14070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f39b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94a0379e-2f28-4d53-90a1-f8718289b741+10:13718:x1868813738027520:12345-192.168.203.32@tcp:502:llog_process_th.0 Request processed in 261us (1886us total) trans 0 rc 0/0 00000100:00100000:0.0:1782240101.116635:0:14070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 89 00000100:00100000:2.0:1782240101.123412:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782240101.123797:0:14077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738027648 00000100:00100000:1.0:1782240101.123807:0:14077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738027648 00000100:00100000:1.0:1782240101.123857:0:14077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 4 00000100:00100000:1.0:1782240101.123865:0:14077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fbe0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2343:x1868813738027648:12345-192.168.203.32@tcp:38:mount.lustre.0 00010000:00080000:1.0:1782240101.123893:0:14077:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from f37709f9-b2ea-4b23-a6ac-c11fd00efb2a@192.168.203.32@tcp t0 exp 0000000000000000 cur 480 last 0 00000020:00000080:1.0:1782240101.124101:0:14077:0:(genops.c:1406:class_connect()) connect: client f37709f9-b2ea-4b23-a6ac-c11fd00efb2a, cookie 0x8c5345f1c1ec6059 00000004:00100000:1.0:1782240101.124137:0:14077:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:1.0:1782240101.124144:0:14077:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:0.0:1782240101.162465:0:14077:0:(import.c:65:import_set_state_nolock()) ffff9bb5f521b000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782240101.162551:0:14077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fbe0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+6:2343:x1868813738027648:12345-192.168.203.32@tcp:38:mount.lustre.0 Request processed in 38684us (39148us total) trans 0 rc 0/0 00000100:00100000:0.0:1782240101.162562:0:14077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 4 00000100:00100000:2.0:1782240101.172552:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782240101.172595:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782240101.172672:0:14078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738027776 00000100:00100000:3.0:1782240101.172683:0:14078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738027776 00000100:00100000:3.0:1782240101.172777:0:14078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738027904 00000100:00100000:3.0:1782240101.172781:0:14078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738027904 00000100:00100000:3.0:1782240101.172800:0:14078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 5 00000100:00100000:3.0:1782240101.172809:0:14078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fbe09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+7:0:x1868813738027776:12345-192.168.203.32@tcp:41:mount.lustre.0 00000004:00000024:3.0:1782240101.172855:0:14078:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1782240101.172941:0:14078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fbe09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+7:0:x1868813738027776:12345-192.168.203.32@tcp:41:mount.lustre.0 Request processed in 133us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1782240101.172949:0:14078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 5 00000100:00100000:3.0:1782240101.172966:0:14078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 6 00000100:00100000:3.0:1782240101.172972:0:14078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fbe0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+6:13694:x1868813738027904:12345-192.168.203.32@tcp:41:mount.lustre.0 00000004:00000024:3.0:1782240101.172983:0:14078:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1782240101.173005:0:14078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fbe0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+6:13694:x1868813738027904:12345-192.168.203.32@tcp:41:mount.lustre.0 Request processed in 33us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1782240101.173010:0:14078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 6 00000100:00080000:0.0:1782240101.173146:0:14072:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782240101.182486:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782240101.182619:0:14078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738028032 00000100:00100000:3.0:1782240101.182632:0:14078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738028032 00000100:00100000:3.0:1782240101.182684:0:14078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 7 00000100:00100000:3.0:1782240101.182693:0:14078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc2abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+6:13694:x1868813738028032:12345-192.168.203.32@tcp:40:mount.lustre.0 00000100:00100000:3.0:1782240101.182823:0:14078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc2abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+6:13694:x1868813738028032:12345-192.168.203.32@tcp:40:mount.lustre.0 Request processed in 130us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1782240101.182830:0:14078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 7 00000100:00100000:2.0:1782240101.189985:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782240101.190037:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782240101.190069:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782240101.190111:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782240101.190145:0:14071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738028544 00000100:00100000:2.0:1782240101.190155:0:14071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738028544 00000100:00100000:2.0:1782240101.190206:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 90 00000100:00100000:2.0:1782240101.190215:0:14071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f39ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94a0379e-2f28-4d53-90a1-f8718289b741+10:2346:x1868813738028544:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:0.0:1782240101.190384:0:14712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738028160 00000100:00100000:0.0:1782240101.190389:0:14712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738028160 00000100:00100000:2.0:1782240101.190428:0:14071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f39ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94a0379e-2f28-4d53-90a1-f8718289b741+10:2346:x1868813738028544:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 213us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1782240101.190436:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 90 00000100:00100000:3.0:1782240101.190514:0:14079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738028416 00000100:00100000:3.0:1782240101.190519:0:14079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738028416 00000100:00100000:3.0:1782240101.190545:0:14079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 0 00000100:00100000:3.0:1782240101.190552:0:14079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fbe08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+6:13694:x1868813738028416:12345-192.168.203.32@tcp:33:mount.lustre.0 00000100:00100000:0.0:1782240101.191221:0:14712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738028288 00000100:00100000:0.0:1782240101.191226:0:14712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738028288 00000100:00100000:1.0:1782240101.191311:0:14713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 8 00000100:00100000:1.0:1782240101.191318:0:14713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fbe0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2343:x1868813738028160:12345-192.168.203.32@tcp:8:mount.lustre.0 00010000:00080000:1.0:1782240101.191344:0:14713:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from f37709f9-b2ea-4b23-a6ac-c11fd00efb2a@192.168.203.32@tcp t0 exp 0000000000000000 cur 480 last 0 00000020:00000080:1.0:1782240101.191384:0:14713:0:(genops.c:1406:class_connect()) connect: client f37709f9-b2ea-4b23-a6ac-c11fd00efb2a, cookie 0x8c5345f1c1ec6060 00002000:00100000:1.0:1782240101.191395:0:14713:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f37709f9-b2ea-4b23-a6ac-c11fd00efb2a/ffff9bb5cfd02000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1782240101.191405:0:14713:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1782240101.191744:0:14713:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1782240101.191800:0:14713:0:(import.c:65:import_set_state_nolock()) ffff9bb5cfd04000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782240101.191847:0:14713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fbe0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+6:2343:x1868813738028160:12345-192.168.203.32@tcp:8:mount.lustre.0 Request processed in 528us (1809us total) trans 0 rc 0/0 00000100:00100000:1.0:1782240101.191855:0:14713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 8 00000100:00100000:1.0:1782240101.191873:0:14713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 9 00000100:00100000:1.0:1782240101.191877:0:14713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fbe0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2343:x1868813738028288:12345-192.168.203.32@tcp:8:mount.lustre.0 00010000:00080000:1.0:1782240101.191907:0:14713:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from f37709f9-b2ea-4b23-a6ac-c11fd00efb2a@192.168.203.32@tcp t0 exp 0000000000000000 cur 480 last 0 00000020:00000080:1.0:1782240101.191929:0:14713:0:(genops.c:1406:class_connect()) connect: client f37709f9-b2ea-4b23-a6ac-c11fd00efb2a, cookie 0x8c5345f1c1ec6067 00002000:00100000:1.0:1782240101.191936:0:14713:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f37709f9-b2ea-4b23-a6ac-c11fd00efb2a/ffff9bb5cfd06000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1782240101.191954:0:14713:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1782240101.192088:0:14713:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1782240101.192118:0:14713:0:(import.c:65:import_set_state_nolock()) ffff9bb5d1ae5000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782240101.192144:0:14713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fbe0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+6:2343:x1868813738028288:12345-192.168.203.32@tcp:8:mount.lustre.0 Request processed in 265us (2073us total) trans 0 rc 0/0 00000100:00100000:1.0:1782240101.192151:0:14713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 9 00000004:00080000:3.0:1782240101.203296:0:14079:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 12688us 00000004:00200000:2.0:1782240101.260312:0:14079:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:2.0:1782240101.260482:0:14079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fbe08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+6:13694:x1868813738028416:12345-192.168.203.32@tcp:33:mount.lustre.0 Request processed in 69923us (70500us total) trans 0 rc 0/0 00000100:00100000:2.0:1782240101.260497:0:14079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 0 00000100:00100000:2.0:1782240101.507895:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782240101.508205:0:14077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738028672 00000100:00100000:0.0:1782240101.508215:0:14077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738028672 00000100:00100000:0.0:1782240101.508276:0:14077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 8 00000100:00100000:0.0:1782240101.508286:0:14077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fbe09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+6:13739:x1868813738028672:12345-192.168.203.32@tcp:101:mkdir.0 00010000:00010000:0.0:1782240101.508309:0:14077:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782240101.508335:0:14077:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031800/0x8c5345f1c1ec606e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e8c8 expref: -99 pid: 14077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240101.508400:0:14077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031000/0x8c5345f1c1ec6075 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240101.508415:0:14077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031000/0x8c5345f1c1ec6075 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240101.508429:0:14077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031000/0x8c5345f1c1ec6075 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782240101.508629:0:14077:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1782240101.508633:0:14077:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1782240101.508717:0:14077:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031000/0x8c5345f1c1ec6075 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240101.508744:0:14077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031800/0x8c5345f1c1ec606e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e8c8 expref: 8 pid: 14077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240101.508796:0:14077:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031000/0x8c5345f1c1ec6075 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e8c8 expref: 7 pid: 14077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240101.508805:0:14077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bb5cfd09400) 00010000:00010000:0.0:1782240101.508808:0:14077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782240101.508811:0:14077:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5c0031000, rc 0) 00000100:00100000:0.0:1782240101.509290:0:14077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fbe09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+7:13739:x1868813738028672:12345-192.168.203.32@tcp:101:mkdir.0 Request processed in 1002us (1400us total) trans 0 rc 0/0 00000100:00100000:0.0:1782240101.509299:0:14077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 8 00010000:00010000:1.0:1782240101.855540:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782240102.175185:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb6018cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1868813758995456:0@lo:400:kworker.0 00000100:00100000:2.0:1782240102.175287:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782240102.175369:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb6018cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813758995584:0@lo:400:kworker.0 00000100:00100000:2.0:1782240102.175400:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782240102.175478:0:14712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758995456 00000100:00100000:2.0:1782240102.175484:0:14712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758995456 00000100:00100000:2.0:1782240102.175532:0:14712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758995584 00000100:00100000:2.0:1782240102.175536:0:14712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758995584 00000100:00100000:2.0:1782240102.175558:0:14712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782240102.175568:0:14712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb6018cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1868813758995456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782240102.175691:0:14712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb6018cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1868813758995456:12345-0@lo:400:kworker.0 Request processed in 125us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1782240102.175700:0:14712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782240102.175719:0:14712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1782240102.175729:0:14712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb6018cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3305:x1868813758995584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782240102.175802:0:14712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb6018cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3305:x1868813758995584:12345-0@lo:400:kworker.0 Request processed in 75us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1782240102.175810:0:14712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1782240102.175856:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb6018cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813758995584:0@lo:400:kworker.0 00000100:00100000:2.0:1782240102.175892:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb6018cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1868813758995456:0@lo:400:kworker.0 00000100:00100000:2.0:1782240102.175901:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb6018cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1868813758995968:0@lo:400:kworker.0 00000100:00100000:2.0:1782240102.175937:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782240102.176041:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fbe08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813758995200:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782240102.176078:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782240102.176110:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb6018cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1868813758995712:0@lo:400:kworker.0 00000100:00100000:1.0:1782240102.176138:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782240102.176163:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1782240102.176170:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb6018cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:3306:1868813758995328:0@lo:400:kworker.0 00000100:00100000:1.0:1782240102.176198:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782240102.176224:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb6018cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1868813758995840:0@lo:400:kworker.0 00000100:00100000:1.0:1782240102.176253:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782240102.176306:0:14076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758995968 00000100:00100000:1.0:1782240102.176310:0:14076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758995968 00000100:00100000:1.0:1782240102.176335:0:14076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758995712 00000100:00100000:1.0:1782240102.176338:0:14076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758995712 00000100:00100000:1.0:1782240102.176351:0:14076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758995840 00000100:00100000:1.0:1782240102.176353:0:14076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758995840 00000100:00100000:1.0:1782240102.176371:0:14076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1782240102.176386:0:14076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb6018cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1868813758995968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782240102.176536:0:14078:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1782240102.176546:0:14078:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1782240102.176583:0:14076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb6018cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1868813758995968:12345-0@lo:400:kworker.0 Request processed in 199us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1782240102.176590:0:14076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1782240102.176606:0:14076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1782240102.176727:0:14076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc2a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1868813758995712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782240102.176932:0:14716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758995200 00000100:00100000:2.0:1782240102.176938:0:14716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758995200 00000100:00100000:2.0:1782240102.176975:0:14716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1782240102.176982:0:14716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc2aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1868813758995200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782240102.177000:0:14716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782240102.177054:0:14716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc2aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1868813758995200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (976us total) trans 0 rc 0/0 00000100:00100000:2.0:1782240102.177061:0:14716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1782240102.177106:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb6018cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1868813758995968:0@lo:400:kworker.0 00000100:00100000:2.0:1782240102.177139:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fbe08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813758995200:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1782240102.178212:0:14072:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782240102.178222:0:14072:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782240102.178225:0:14072:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782240102.178242:0:14070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758995328 00000100:00100000:0.0:1782240102.178248:0:14070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758995328 00000100:00100000:0.0:1782240102.178294:0:14070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1782240102.178304:0:14070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f39bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+19:3306:x1868813758995328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782240102.178375:0:14070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f39bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+19:3306:x1868813758995328:12345-0@lo:400:kworker.0 Request processed in 74us (2176us total) trans 0 rc 0/0 00000100:00100000:0.0:1782240102.178384:0:14070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1782240102.178999:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb6018cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:3306:1868813758995328:0@lo:400:kworker.0 00000100:00100000:0.0:1782240102.179113:0:14077:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1782240102.179125:0:14077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1782240102.179144:0:14077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc2a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1868813758995840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782240102.179206:0:14077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc2a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1868813758995840:12345-0@lo:400:kworker.0 Request processed in 66us (2953us total) trans 0 rc 0/0 00000100:00100000:0.0:1782240102.179215:0:14077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1782240102.179254:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb6018cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1868813758995840:0@lo:400:kworker.0 00000100:00100000:3.0:1782240102.184266:0:14076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc2a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1868813758995712:12345-0@lo:400:kworker.0 Request processed in 7647us (8121us total) trans 0 rc 0/0 00000100:00100000:3.0:1782240102.184280:0:14076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1782240102.184966:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb6018cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1868813758995712:0@lo:400:kworker.0 00000001:00100000:1.0:1782240102.279426:0:7493:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f37709f9-b2ea-4b23-a6ac-c11fd00efb2a 00000001:00100000:1.0:1782240102.279441:0:7493:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1782240102.279451:0:7493:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:1.0:1782240102.736012:0:6614:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f37709f9-b2ea-4b23-a6ac-c11fd00efb2a 00010000:00010000:1.0:1782240102.879028:0:14064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782240103.561688:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782240103.563469:0:14077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738028800 00000100:00100000:0.0:1782240103.563484:0:14077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738028800 00000100:00100000:0.0:1782240103.563574:0:14077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 9 00000100:00100000:0.0:1782240103.563585:0:14077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc2a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+7:13791:x1868813738028800:12345-192.168.203.32@tcp:41:lfs.0 00000004:00000024:0.0:1782240103.563629:0:14077:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1782240103.563726:0:14077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc2a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+7:13791:x1868813738028800:12345-192.168.203.32@tcp:41:lfs.0 Request processed in 143us (2045us total) trans 0 rc 0/0 00000100:00100000:0.0:1782240103.563733:0:14077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 9 00000100:00080000:2.0:1782240103.565874:0:14072:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782240103.567866:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782240103.569835:0:14716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738028928 00000100:00100000:2.0:1782240103.569850:0:14716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738028928 00000100:00100000:2.0:1782240103.570014:0:14716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 5 00000100:00100000:2.0:1782240103.570027:0:14716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f77a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+5:13791:x1868813738028928:12345-192.168.203.32@tcp:13:lfs.0 00002000:00000024:2.0:1782240103.570069:0:14716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782240103.570160:0:14716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f77a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+5:13791:x1868813738028928:12345-192.168.203.32@tcp:13:lfs.0 Request processed in 137us (2303us total) trans 0 rc 0/0 00000100:00100000:2.0:1782240103.570168:0:14716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 5 00000100:00080000:0.0:1782240103.570401:0:14072:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782240103.573630:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782240103.575291:0:14715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738029056 00000100:00100000:1.0:1782240103.575305:0:14715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738029056 00000100:00100000:1.0:1782240103.575413:0:14715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 6 00000100:00100000:1.0:1782240103.575424:0:14715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f4897100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+5:13791:x1868813738029056:12345-192.168.203.32@tcp:13:lfs.0 00002000:00000024:1.0:1782240103.575465:0:14715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782240103.575565:0:14715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f4897100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+5:13791:x1868813738029056:12345-192.168.203.32@tcp:13:lfs.0 Request processed in 143us (1943us total) trans 0 rc 0/0 00000100:00100000:1.0:1782240103.575573:0:14715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 6 00000100:00080000:0.0:1782240103.575878:0:14072:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782240103.754212:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782240103.754409:0:14068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738029184 00000100:00100000:2.0:1782240103.754424:0:14068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738029184 00000100:00100000:2.0:1782240103.754571:0:14068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 92 00000100:00100000:2.0:1782240103.754585:0:14068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f39ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94a0379e-2f28-4d53-90a1-f8718289b741+10:13822:x1868813738029184:12345-192.168.203.32@tcp:101:mount.lustre.0 00010000:00010000:2.0:1782240103.754612:0:14068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782240103.754639:0:14068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb4c2019000/0x8c5345f1c1ec607c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e8cf expref: -99 pid: 14068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240103.754678:0:14068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb4c2019000/0x8c5345f1c1ec607c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e8cf expref: 11 pid: 14068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240103.754691:0:14068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb4c2019000/0x8c5345f1c1ec607c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e8cf expref: 11 pid: 14068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240103.754702:0:14068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb4c2019000, rc 0) 00000100:00100000:2.0:1782240103.754812:0:14068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f39ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94a0379e-2f28-4d53-90a1-f8718289b741+11:13822:x1868813738029184:12345-192.168.203.32@tcp:101:mount.lustre.0 Request processed in 231us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1782240103.754837:0:14068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 92 00000100:00100000:3.0:1782240103.758055:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782240103.759071:0:14071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738029312 00000100:00100000:0.0:1782240103.759096:0:14071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738029312 00000100:00100000:0.0:1782240103.759183:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 93 00000100:00100000:0.0:1782240103.759195:0:14071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f39bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94a0379e-2f28-4d53-90a1-f8718289b741+11:13822:x1868813738029312:12345-192.168.203.32@tcp:501:mount.lustre.0 00000100:00100000:0.0:1782240103.759927:0:14071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f39bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94a0379e-2f28-4d53-90a1-f8718289b741+11:13822:x1868813738029312:12345-192.168.203.32@tcp:501:mount.lustre.0 Request processed in 728us (1880us total) trans 0 rc 0/0 00000100:00100000:0.0:1782240103.759938:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 93 00000100:00100000:3.0:1782240103.796229:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782240103.796662:0:14068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738029440 00000100:00100000:2.0:1782240103.796683:0:14068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738029440 00000100:00100000:2.0:1782240103.796818:0:14068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 94 00000100:00100000:2.0:1782240103.796831:0:14068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f39bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94a0379e-2f28-4d53-90a1-f8718289b741+11:13822:x1868813738029440:12345-192.168.203.32@tcp:503:mount.lustre.0 00000100:00100000:2.0:1782240103.797178:0:14068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f39bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94a0379e-2f28-4d53-90a1-f8718289b741+11:13822:x1868813738029440:12345-192.168.203.32@tcp:503:mount.lustre.0 Request processed in 343us (958us total) trans 0 rc 0/0 00000100:00100000:2.0:1782240103.797187:0:14068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 94 00000100:00100000:1.0:1782240103.809715:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782240103.810125:0:14071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738029568 00000100:00100000:0.0:1782240103.810140:0:14071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738029568 00000100:00100000:0.0:1782240103.810218:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 95 00000100:00100000:0.0:1782240103.810250:0:14071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d81c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94a0379e-2f28-4d53-90a1-f8718289b741+11:13830:x1868813738029568:12345-192.168.203.32@tcp:502:llog_process_th.0 00000100:00100000:0.0:1782240103.810613:0:14071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d81c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94a0379e-2f28-4d53-90a1-f8718289b741+11:13830:x1868813738029568:12345-192.168.203.32@tcp:502:llog_process_th.0 Request processed in 364us (911us total) trans 0 rc 0/0 00000100:00100000:0.0:1782240103.810623:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 95 00000100:00100000:3.0:1782240103.840672:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782240103.842506:0:14068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738029696 00000100:00100000:2.0:1782240103.842530:0:14068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738029696 00000100:00100000:2.0:1782240103.842628:0:14068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 96 00000100:00100000:2.0:1782240103.842640:0:14068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d81c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94a0379e-2f28-4d53-90a1-f8718289b741+11:13830:x1868813738029696:12345-192.168.203.32@tcp:502:llog_process_th.0 00000100:00100000:2.0:1782240103.843226:0:14068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d81c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94a0379e-2f28-4d53-90a1-f8718289b741+11:13830:x1868813738029696:12345-192.168.203.32@tcp:502:llog_process_th.0 Request processed in 585us (2565us total) trans 0 rc 0/0 00000100:00100000:2.0:1782240103.843237:0:14068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 96 00000100:00100000:3.0:1782240103.849058:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782240103.849430:0:14070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738029824 00000100:00100000:2.0:1782240103.849444:0:14070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738029824 00000100:00100000:2.0:1782240103.849523:0:14070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 97 00000100:00100000:2.0:1782240103.849536:0:14070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d81c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94a0379e-2f28-4d53-90a1-f8718289b741+11:13822:x1868813738029824:12345-192.168.203.32@tcp:101:mount.lustre.0 00010000:00010000:2.0:1782240103.849560:0:14070:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782240103.849587:0:14070:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb4c2018200/0x8c5345f1c1ec6083 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e8f9 expref: -99 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240103.849622:0:14070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb4c2018200/0x8c5345f1c1ec6083 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e8f9 expref: 12 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240103.849656:0:14070:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb4c2018200/0x8c5345f1c1ec6083 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e8f9 expref: 12 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240103.850107:0:14070:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb4c2018200, rc 0) 00000100:00100000:2.0:1782240103.850250:0:14070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d81c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94a0379e-2f28-4d53-90a1-f8718289b741+12:13822:x1868813738029824:12345-192.168.203.32@tcp:101:mount.lustre.0 Request processed in 715us (1204us total) trans 0 rc 0/0 00000100:00100000:2.0:1782240103.850259:0:14070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 97 00000100:00100000:1.0:1782240103.855893:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782240103.856549:0:14068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738029952 00000100:00100000:2.0:1782240103.856563:0:14068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738029952 00000100:00100000:2.0:1782240103.858306:0:14068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 98 00000100:00100000:2.0:1782240103.858338:0:14068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d81c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94a0379e-2f28-4d53-90a1-f8718289b741+12:13822:x1868813738029952:12345-192.168.203.32@tcp:256:mount.lustre.0 20000000:01000000:2.0:1782240103.858377:0:14068:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1782240103.858412:0:14068:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1782240103.858417:0:14068:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1782240103.858421:0:14068:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1782240103.858424:0:14068:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1782240103.868239:0:14068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d81c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94a0379e-2f28-4d53-90a1-f8718289b741+12:13822:x1868813738029952:12345-192.168.203.32@tcp:256:mount.lustre.0 Request processed in 9902us (12347us total) trans 0 rc 0/0 00000100:00100000:1.0:1782240103.868278:0:14068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 98 00000100:00100000:3.0:1782240103.871394:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782240103.871506:0:14070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738030080 00000100:00100000:2.0:1782240103.871519:0:14070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738030080 00000100:00100000:2.0:1782240103.871596:0:14070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 99 00000100:00100000:2.0:1782240103.871608:0:14070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d81c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94a0379e-2f28-4d53-90a1-f8718289b741+12:13822:x1868813738030080:12345-192.168.203.32@tcp:101:mount.lustre.0 00010000:00010000:2.0:1782240103.871630:0:14070:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782240103.871652:0:14070:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb4c2018600/0x8c5345f1c1ec608a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e900 expref: -99 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240103.872045:0:14070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb4c2018600/0x8c5345f1c1ec608a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e900 expref: 13 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240103.872083:0:14070:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb4c2018600/0x8c5345f1c1ec608a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e900 expref: 13 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240103.872095:0:14070:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb4c2018600, rc 0) 00000100:00100000:2.0:1782240103.872216:0:14070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d81c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94a0379e-2f28-4d53-90a1-f8718289b741+13:13822:x1868813738030080:12345-192.168.203.32@tcp:101:mount.lustre.0 Request processed in 610us (836us total) trans 0 rc 0/0 00000100:00100000:2.0:1782240103.872226:0:14070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 99 00000100:00100000:3.0:1782240103.877939:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782240103.878091:0:14068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738030208 00000100:00100000:2.0:1782240103.878104:0:14068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738030208 00000100:00100000:2.0:1782240103.878178:0:14068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 100 00000100:00100000:2.0:1782240103.878191:0:14068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d81c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94a0379e-2f28-4d53-90a1-f8718289b741+13:13822:x1868813738030208:12345-192.168.203.32@tcp:501:mount.lustre.0 00000100:00100000:2.0:1782240103.878610:0:14068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d81c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94a0379e-2f28-4d53-90a1-f8718289b741+13:13822:x1868813738030208:12345-192.168.203.32@tcp:501:mount.lustre.0 Request processed in 420us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1782240103.878620:0:14068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 100 00000100:00100000:3.0:1782240103.880882:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782240103.881130:0:14070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738030336 00000100:00100000:2.0:1782240103.881143:0:14070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738030336 00000100:00100000:2.0:1782240103.881219:0:14070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 101 00000100:00100000:2.0:1782240103.881233:0:14070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d81c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94a0379e-2f28-4d53-90a1-f8718289b741+13:13822:x1868813738030336:12345-192.168.203.32@tcp:503:mount.lustre.0 00000100:00100000:2.0:1782240103.882177:0:14070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d81c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94a0379e-2f28-4d53-90a1-f8718289b741+13:13822:x1868813738030336:12345-192.168.203.32@tcp:503:mount.lustre.0 Request processed in 942us (1302us total) trans 0 rc 0/0 00000100:00100000:2.0:1782240103.882189:0:14070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 101 00000100:00100000:1.0:1782240103.887462:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782240103.888527:0:14071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738030464 00000100:00100000:0.0:1782240103.888546:0:14071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738030464 00000100:00100000:0.0:1782240103.888691:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 102 00000100:00100000:0.0:1782240103.888704:0:14071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d81c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94a0379e-2f28-4d53-90a1-f8718289b741+13:13833:x1868813738030464:12345-192.168.203.32@tcp:502:llog_process_th.0 00000100:00100000:0.0:1782240103.889150:0:14071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d81c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94a0379e-2f28-4d53-90a1-f8718289b741+13:13833:x1868813738030464:12345-192.168.203.32@tcp:502:llog_process_th.0 Request processed in 447us (1700us total) trans 0 rc 0/0 00000100:00100000:0.0:1782240103.889160:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 102 00000100:00100000:3.0:1782240103.893443:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782240103.893572:0:14070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738030592 00000100:00100000:2.0:1782240103.893585:0:14070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738030592 00000100:00100000:2.0:1782240103.893658:0:14070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 103 00000100:00100000:2.0:1782240103.893683:0:14070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d81c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94a0379e-2f28-4d53-90a1-f8718289b741+13:13833:x1868813738030592:12345-192.168.203.32@tcp:502:llog_process_th.0 00000100:00100000:2.0:1782240103.894262:0:14070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d81c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94a0379e-2f28-4d53-90a1-f8718289b741+13:13833:x1868813738030592:12345-192.168.203.32@tcp:502:llog_process_th.0 Request processed in 579us (831us total) trans 0 rc 0/0 00000100:00100000:2.0:1782240103.894272:0:14070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 103 00010000:00010000:1.0:1782240103.903082:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782240103.907163:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782240103.911469:0:14076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738030720 00000100:00100000:1.0:1782240103.911503:0:14076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738030720 00000100:00100000:1.0:1782240103.911632:0:14076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 10 00000100:00100000:1.0:1782240103.911643:0:14076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f4896d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2343:x1868813738030720:12345-192.168.203.32@tcp:38:mount.lustre.0 00010000:00080000:1.0:1782240103.911707:0:14076:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from e915549f-7383-4873-bb08-ab4dbf0961dd@192.168.203.32@tcp t0 exp 0000000000000000 cur 482 last 0 00000020:00000080:1.0:1782240103.911827:0:14076:0:(genops.c:1406:class_connect()) connect: client e915549f-7383-4873-bb08-ab4dbf0961dd, cookie 0x8c5345f1c1ec6091 00000004:00100000:1.0:1782240103.911887:0:14076:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1782240103.912189:0:14076:0:(import.c:65:import_set_state_nolock()) ffff9bb5d1ae0000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782240103.912340:0:14076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f4896d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e915549f-7383-4873-bb08-ab4dbf0961dd+6:2343:x1868813738030720:12345-192.168.203.32@tcp:38:mount.lustre.0 Request processed in 696us (5190us total) trans 0 rc 0/0 00000100:00100000:1.0:1782240103.912350:0:14076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 10 00000100:00100000:0.0:1782240103.919620:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782240103.919983:0:14077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738030976 00000100:00100000:2.0:1782240103.920006:0:14077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738030976 00000100:00100000:2.0:1782240103.920104:0:14077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 11 00000100:00100000:2.0:1782240103.920116:0:14077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f77a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e915549f-7383-4873-bb08-ab4dbf0961dd+6:13822:x1868813738030976:12345-192.168.203.32@tcp:41:mount.lustre.0 00000004:00000024:2.0:1782240103.920158:0:14077:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1782240103.920239:0:14077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f77a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e915549f-7383-4873-bb08-ab4dbf0961dd+6:13822:x1868813738030976:12345-192.168.203.32@tcp:41:mount.lustre.0 Request processed in 124us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1782240103.920247:0:14077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 11 00000100:00080000:3.0:1782240103.920325:0:14072:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782240103.921015:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782240103.921107:0:14076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738030848 00000100:00100000:3.0:1782240103.921115:0:14076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738030848 00000100:00100000:3.0:1782240103.921155:0:14076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 12 00000100:00100000:3.0:1782240103.921162:0:14076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f77a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e915549f-7383-4873-bb08-ab4dbf0961dd+6:0:x1868813738030848:12345-192.168.203.32@tcp:41:mount.lustre.0 00000004:00000024:3.0:1782240103.921189:0:14076:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1782240103.921249:0:14076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f77a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e915549f-7383-4873-bb08-ab4dbf0961dd+6:0:x1868813738030848:12345-192.168.203.32@tcp:41:mount.lustre.0 Request processed in 87us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1782240103.921286:0:14076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 12 00000100:00100000:3.0:1782240103.923517:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782240103.923846:0:14077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738031104 00000100:00100000:2.0:1782240103.923858:0:14077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738031104 00000100:00100000:2.0:1782240103.923926:0:14077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 13 00000100:00100000:2.0:1782240103.923937:0:14077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f4897480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e915549f-7383-4873-bb08-ab4dbf0961dd+6:13822:x1868813738031104:12345-192.168.203.32@tcp:40:mount.lustre.0 00000100:00100000:2.0:1782240103.924063:0:14077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f4897480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e915549f-7383-4873-bb08-ab4dbf0961dd+6:13822:x1868813738031104:12345-192.168.203.32@tcp:40:mount.lustre.0 Request processed in 128us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1782240103.924071:0:14077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 13 00000100:00100000:0.0:1782240103.928606:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782240103.928649:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782240103.928697:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782240103.928958:0:14714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738031232 00000100:00100000:3.0:1782240103.928972:0:14714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738031232 00000100:00100000:3.0:1782240103.929030:0:14714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738031360 00000100:00100000:3.0:1782240103.929034:0:14714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738031360 00000100:00100000:3.0:1782240103.929052:0:14714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 10 00000100:00100000:3.0:1782240103.929061:0:14714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f77a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2343:x1868813738031232:12345-192.168.203.32@tcp:8:mount.lustre.0 00010000:00080000:3.0:1782240103.929101:0:14714:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from e915549f-7383-4873-bb08-ab4dbf0961dd@192.168.203.32@tcp t0 exp 0000000000000000 cur 483 last 0 00000020:00000080:3.0:1782240103.929149:0:14714:0:(genops.c:1406:class_connect()) connect: client e915549f-7383-4873-bb08-ab4dbf0961dd, cookie 0x8c5345f1c1ec6098 00002000:00100000:3.0:1782240103.929167:0:14714:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli e915549f-7383-4873-bb08-ab4dbf0961dd/ffff9bb5f5193800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1782240103.929183:0:14714:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1782240103.929505:0:14714:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1782240103.929553:0:14714:0:(import.c:65:import_set_state_nolock()) ffff9bb5f5197800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782240103.929649:0:14714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f77a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e915549f-7383-4873-bb08-ab4dbf0961dd+6:2343:x1868813738031232:12345-192.168.203.32@tcp:8:mount.lustre.0 Request processed in 587us (998us total) trans 0 rc 0/0 00000100:00100000:3.0:1782240103.929670:0:14714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 10 00000100:00100000:3.0:1782240103.929697:0:14714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 11 00000100:00100000:3.0:1782240103.929702:0:14714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f77a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2343:x1868813738031360:12345-192.168.203.32@tcp:8:mount.lustre.0 00010000:00080000:3.0:1782240103.929722:0:14714:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from e915549f-7383-4873-bb08-ab4dbf0961dd@192.168.203.32@tcp t0 exp 0000000000000000 cur 483 last 0 00000020:00000080:3.0:1782240103.929744:0:14714:0:(genops.c:1406:class_connect()) connect: client e915549f-7383-4873-bb08-ab4dbf0961dd, cookie 0x8c5345f1c1ec609f 00002000:00100000:3.0:1782240103.929788:0:14714:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli e915549f-7383-4873-bb08-ab4dbf0961dd/ffff9bb5f5196000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1782240103.930036:0:14714:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1782240103.930208:0:14714:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1782240103.930248:0:14714:0:(import.c:65:import_set_state_nolock()) ffff9bb5f5193000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782240103.930298:0:14714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f77a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e915549f-7383-4873-bb08-ab4dbf0961dd+6:2343:x1868813738031360:12345-192.168.203.32@tcp:8:mount.lustre.0 Request processed in 593us (1599us total) trans 0 rc 0/0 00000100:00100000:3.0:1782240103.930306:0:14714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 11 00000100:00100000:1.0:1782240103.931007:0:14080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738031488 00000100:00100000:1.0:1782240103.931017:0:14080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738031488 00000100:00100000:1.0:1782240103.931073:0:14080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 1 00000100:00100000:1.0:1782240103.931083:0:14080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f77a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e915549f-7383-4873-bb08-ab4dbf0961dd+6:13822:x1868813738031488:12345-192.168.203.32@tcp:33:mount.lustre.0 00000004:00200000:1.0:1782240103.931516:0:14080:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:1.0:1782240103.932839:0:14080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f77a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e915549f-7383-4873-bb08-ab4dbf0961dd+6:13822:x1868813738031488:12345-192.168.203.32@tcp:33:mount.lustre.0 Request processed in 1747us (4239us total) trans 0 rc 0/0 00000100:00100000:1.0:1782240103.932852:0:14080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 1 00000100:00100000:0.0:1782240104.078717:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782240104.078902:0:14076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738031616 00000100:00100000:3.0:1782240104.078917:0:14076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738031616 00000100:00100000:3.0:1782240104.079005:0:14076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 14 00000100:00100000:3.0:1782240104.079017:0:14076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f77a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e915549f-7383-4873-bb08-ab4dbf0961dd+6:13854:x1868813738031616:12345-192.168.203.32@tcp:101:mkdir.0 00010000:00010000:3.0:1782240104.079045:0:14076:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782240104.079080:0:14076:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26200/0x8c5345f1c1ec60a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e92a expref: -99 pid: 14076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240104.079175:0:14076:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27e00/0x8c5345f1c1ec60ad lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240104.079192:0:14076:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27e00/0x8c5345f1c1ec60ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240104.079209:0:14076:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27e00/0x8c5345f1c1ec60ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14076 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782240104.079465:0:14076:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1782240104.079469:0:14076:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1782240104.079542:0:14076:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27e00/0x8c5345f1c1ec60ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240104.079573:0:14076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26200/0x8c5345f1c1ec60a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e92a expref: 8 pid: 14076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240104.079593:0:14076:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27e00/0x8c5345f1c1ec60ad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e92a expref: 7 pid: 14076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240104.079611:0:14076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bb5cfd09400) 00010000:00010000:3.0:1782240104.079614:0:14076:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782240104.079618:0:14076:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5f7e27e00, rc 0) 00000100:00100000:3.0:1782240104.079702:0:14076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f77a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e915549f-7383-4873-bb08-ab4dbf0961dd+7:13854:x1868813738031616:12345-192.168.203.32@tcp:101:mkdir.0 Request processed in 686us (1001us total) trans 0 rc 0/0 00000100:00100000:3.0:1782240104.079712:0:14076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 14 00010000:00010000:3.0:1782240104.927128:0:14064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1782240105.505068:0:14110:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1782240105.759730:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782240105.764766:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f4894380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1868813758996096:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782240105.764881:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782240105.765143:0:14715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758996096 00000100:00100000:1.0:1782240105.765156:0:14715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758996096 00000100:00080000:3.0:1782240105.765281:0:14072:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782240105.769684:0:14715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1782240105.769718:0:14715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5eddf5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1868813758996096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782240105.769797:0:14715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782240105.769908:0:14715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5eddf5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1868813758996096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 208us (5027us total) trans 0 rc 0/0 00000100:00100000:1.0:1782240105.769917:0:14715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1782240105.770228:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f4894380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1868813758996096:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1782240105.960181:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1782240106.356799:0:5812:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f37709f9-b2ea-4b23-a6ac-c11fd00efb2a 00000001:00100000:1.0:1782240106.356820:0:5812:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e915549f-7383-4873-bb08-ab4dbf0961dd 00000001:02000400:3.0:1782240106.955398:0:15939:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1782240106.979494:0:14064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782240107.296952:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fc2aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1868813758996352:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782240107.297058:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782240107.297134:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782240107.297140:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f4894700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1868813758996608:0@lo:400:kworker.0 00000100:00100000:0.0:1782240107.297189:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782240107.297557:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f4897b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:3306:1868813758996224:0@lo:400:kworker.0 00000100:00100000:2.0:1782240107.297598:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782240107.297632:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782240107.297638:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f4894000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813758996480:0@lo:400:kworker.0 00000100:00100000:2.0:1782240107.297662:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782240107.297701:0:14712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758996608 00000100:00100000:2.0:1782240107.297709:0:14712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758996608 00000100:00100000:2.0:1782240107.297797:0:14712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758996480 00000100:00100000:2.0:1782240107.297801:0:14712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758996480 00000100:00100000:2.0:1782240107.297820:0:14712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1782240107.297829:0:14712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5eddf4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1868813758996608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782240107.297892:0:14712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5eddf4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1868813758996608:12345-0@lo:400:kworker.0 Request processed in 64us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1782240107.297900:0:14712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1782240107.297919:0:14712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1782240107.297925:0:14712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb6018cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1868813758996480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782240107.297957:0:14712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb6018cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1868813758996480:12345-0@lo:400:kworker.0 Request processed in 32us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1782240107.297962:0:14712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1782240107.298015:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f4894000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813758996480:0@lo:400:kworker.0 00000100:00100000:2.0:1782240107.298045:0:3304:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1782240107.298057:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f4894700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1868813758996608:0@lo:400:kworker.0 00000100:00100000:0.0:1782240107.298426:0:14715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758996352 00000100:00100000:0.0:1782240107.298433:0:14715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758996352 00000100:00100000:0.0:1782240107.298477:0:14715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1782240107.298484:0:14715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5eddf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1868813758996352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782240107.298518:0:14715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782240107.298567:0:14715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5eddf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1868813758996352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (1510us total) trans 0 rc 0/0 00000100:00100000:0.0:1782240107.298573:0:14715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1782240107.298594:0:14071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758996224 00000100:00100000:0.0:1782240107.298598:0:14071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758996224 00000100:00100000:0.0:1782240107.298869:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1782240107.298878:0:14071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d81c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+19:3306:x1868813758996224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782240107.298920:0:14071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d81c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+19:3306:x1868813758996224:12345-0@lo:400:kworker.0 Request processed in 44us (1321us total) trans 0 rc 0/0 00000100:00100000:0.0:1782240107.298927:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1782240107.298999:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f4897b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:3306:1868813758996224:0@lo:400:kworker.0 00000100:00100000:0.0:1782240107.299037:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fc2aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1868813758996352:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1782240107.301689:0:14072:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782240107.301704:0:14072:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782240107.301979:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f4895180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1868813758996736:0@lo:400:kworker.0 00000100:00100000:3.0:1782240107.302073:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782240107.302393:0:14077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758996736 00000100:00100000:3.0:1782240107.302404:0:14077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758996736 00000100:00100000:3.0:1782240107.302466:0:14077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1782240107.302477:0:14077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f4897b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1868813758996736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782240107.302543:0:14077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f4897b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1868813758996736:12345-0@lo:400:kworker.0 Request processed in 67us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1782240107.302551:0:14077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1782240107.302605:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f4895180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1868813758996736:0@lo:400:kworker.0 00000100:00100000:3.0:1782240107.303499:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f4895180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1868813758996864:0@lo:400:kworker.0 00000100:00100000:3.0:1782240107.303552:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782240107.303871:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f4894000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1868813758996992:0@lo:400:kworker.0 00000100:00100000:3.0:1782240107.303903:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782240107.303952:0:15850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758996864 00000100:00100000:3.0:1782240107.303958:0:15850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758996864 00000100:00100000:3.0:1782240107.304021:0:15850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758996992 00000100:00100000:3.0:1782240107.304026:0:15850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758996992 00000100:00100000:3.0:1782240107.304055:0:15850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1782240107.304066:0:15850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f4894700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1868813758996864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782240107.304178:0:14076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1782240107.304189:0:14076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f4894380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1868813758996992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782240107.304509:0:15850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f4894700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1868813758996864:12345-0@lo:400:kworker.0 Request processed in 445us (955us total) trans 0 rc 0/0 00000100:00100000:0.0:1782240107.304512:0:14076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f4894380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1868813758996992:12345-0@lo:400:kworker.0 Request processed in 323us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1782240107.304523:0:15850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1782240107.304530:0:14076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1782240107.304580:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f4895180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1868813758996864:0@lo:400:kworker.0 00000100:00080000:3.0:1782240107.304608:0:14072:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782240107.305247:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f4894000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1868813758996992:0@lo:400:kworker.0 00000001:00100000:2.0:1782240107.364346:0:7493:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e915549f-7383-4873-bb08-ab4dbf0961dd 00000001:00100000:0.0:1782240107.882608:0:6614:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e915549f-7383-4873-bb08-ab4dbf0961dd 00010000:00010000:1.0:1782240108.000254:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782240109.024888:0:14064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782240109.078519:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782240109.078568:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782240109.078586:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782240109.078623:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782240109.078646:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782240109.078665:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782240109.078689:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782240109.078718:0:14068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738031744 00000100:00100000:1.0:1782240109.078730:0:14068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738031744 00000100:00100000:1.0:1782240109.078817:0:14068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 105 00000100:00100000:1.0:1782240109.078829:0:14068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d81c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94a0379e-2f28-4d53-90a1-f8718289b741+13:2347:x1868813738031744:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:1.0:1782240109.078920:0:14068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d81c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94a0379e-2f28-4d53-90a1-f8718289b741+13:2347:x1868813738031744:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 93us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1782240109.078941:0:14068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 105 00000100:00100000:1.0:1782240109.078991:0:14714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738032128 00000100:00100000:1.0:1782240109.079005:0:14714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738032128 00000100:00100000:1.0:1782240109.079041:0:14714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738032384 00000100:00100000:1.0:1782240109.079044:0:14714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738032384 00000100:00100000:1.0:1782240109.079059:0:14714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738032000 00000100:00100000:1.0:1782240109.079061:0:14714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738032000 00000100:00100000:1.0:1782240109.079076:0:14714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738032512 00000100:00100000:1.0:1782240109.079078:0:14714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738032512 00000100:00100000:1.0:1782240109.079094:0:14714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 6 00000100:00100000:1.0:1782240109.079100:0:14714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc2a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+5:2347:x1868813738032128:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:1.0:1782240109.079132:0:14714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc2a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+5:2347:x1868813738032128:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 32us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1782240109.079139:0:14714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 6 00000100:00100000:1.0:1782240109.079152:0:14714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 7 00000100:00100000:1.0:1782240109.079158:0:14714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc2a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e915549f-7383-4873-bb08-ab4dbf0961dd+5:2347:x1868813738032384:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:1.0:1782240109.079183:0:14714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc2a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e915549f-7383-4873-bb08-ab4dbf0961dd+5:2347:x1868813738032384:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 25us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1782240109.079189:0:14714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 7 00000100:00100000:1.0:1782240109.079200:0:14714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 8 00000100:00100000:1.0:1782240109.079206:0:14714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+5:2347:x1868813738032000:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:1.0:1782240109.079228:0:14714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+5:2347:x1868813738032000:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 22us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1782240109.079234:0:14714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 8 00000100:00100000:1.0:1782240109.079258:0:14714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 9 00000100:00100000:1.0:1782240109.079264:0:14714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e915549f-7383-4873-bb08-ab4dbf0961dd+5:2347:x1868813738032512:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:1.0:1782240109.079287:0:14714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e915549f-7383-4873-bb08-ab4dbf0961dd+5:2347:x1868813738032512:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 23us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1782240109.079301:0:14714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 9 00000100:00080000:1.0:1782240109.079319:0:14072:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782240109.079324:0:14072:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782240109.079507:0:15850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738031872 00000100:00100000:2.0:1782240109.079513:0:15850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738031872 00000100:00100000:2.0:1782240109.079560:0:15850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738032256 00000100:00100000:2.0:1782240109.079564:0:15850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738032256 00000100:00100000:2.0:1782240109.079589:0:15850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 19 00000100:00100000:2.0:1782240109.079597:0:15850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc2aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+6:2347:x1868813738031872:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:2.0:1782240109.079630:0:15850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc2aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+6:2347:x1868813738031872:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 34us (1126us total) trans 0 rc 0/0 00000100:00100000:2.0:1782240109.079637:0:15850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 19 00000100:00100000:2.0:1782240109.079650:0:15850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 20 00000100:00100000:2.0:1782240109.079665:0:15850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e915549f-7383-4873-bb08-ab4dbf0961dd+6:2347:x1868813738032256:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:2.0:1782240109.079693:0:15850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e915549f-7383-4873-bb08-ab4dbf0961dd+6:2347:x1868813738032256:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 30us (1027us total) trans 0 rc 0/0 00000100:00100000:2.0:1782240109.079699:0:15850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 20 00000100:00080000:1.0:1782240109.081471:0:14072:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1782240110.056368:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782240110.221125:0:16089:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffeb3b96df0 20000000:00000080:3.0:1782240110.221143:0:16089:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9bb5f4c43800 uarg=0000000000000000 20000000:01000000:3.0:1782240110.221181:0:16089:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1782240110.221187:0:16089:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1782240110.221192:0:16089:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1782240110.222245:0:16090:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:3.0:1782240110.222454:0:16089:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1782240110.236087:0:16089:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1782240110.236118:0:16089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bb5f7e26200/0x8c5345f1c1ec60b4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240110.236135:0:16089:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bb5ee29f400/0x8c5345f1c1ec5dab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c5345f1c1ec5da4 expref: 18 pid: 14071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240110.236143:0:16089:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bb5f7e38400/0x8c5345f1c1ec5df8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c5345f1c1ec5df1 expref: 18 pid: 14071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240110.236169:0:16089:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bb5c0030000/0x8c5345f1c1ec5f2c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c5345f1c1ec5f25 expref: 18 pid: 14071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240110.236178:0:16089:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bb5c0031a00/0x8c5345f1c1ec6052 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e89e expref: 12 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240110.236185:0:16089:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bb4c2018600/0x8c5345f1c1ec608a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e900 expref: 12 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240110.236192:0:16089:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bb5f7e26200/0x8c5345f1c1ec60b4 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240110.236235:0:16089:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bb4c2018600/0x8c5345f1c1ec608a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e900 expref: 12 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240110.236249:0:16089:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bb4c2018600/0x8c5345f1c1ec608a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e900 expref: 12 pid: 14070 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782240110.238962:0:16089:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f4894000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16089:1868813758997120:192.168.203.32@tcp:104: 00010000:00010000:3.0:1782240110.239093:0:16089:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bb5c0031a00/0x8c5345f1c1ec6052 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e89e expref: 12 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240110.239105:0:16089:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bb5c0031a00/0x8c5345f1c1ec6052 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e89e expref: 12 pid: 14070 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782240110.239114:0:16089:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f4895180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16089:1868813758997248:192.168.203.32@tcp:104: 00010000:00010000:3.0:1782240110.239147:0:16089:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bb5c0030000/0x8c5345f1c1ec5f2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8c5345f1c1ec5f25 expref: 18 pid: 14071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240110.239184:0:16089:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bb5c0030000/0x8c5345f1c1ec5f2c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8c5345f1c1ec5f25 expref: 18 pid: 14071 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782240110.239195:0:16089:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f4895500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16089:1868813758997376:0@lo:104: 00000100:00100000:3.0:1782240110.239236:0:16089:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782240110.239271:0:16089:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bb5f7e38400/0x8c5345f1c1ec5df8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8c5345f1c1ec5df1 expref: 18 pid: 14071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240110.239280:0:16089:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bb5f7e38400/0x8c5345f1c1ec5df8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8c5345f1c1ec5df1 expref: 18 pid: 14071 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782240110.239288:0:16089:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f46fc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16089:1868813758997504:0@lo:104: 00000100:00100000:3.0:1782240110.239308:0:16089:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782240110.239328:0:16089:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bb5ee29f400/0x8c5345f1c1ec5dab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8c5345f1c1ec5da4 expref: 18 pid: 14071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240110.239336:0:16089:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bb5ee29f400/0x8c5345f1c1ec5dab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8c5345f1c1ec5da4 expref: 18 pid: 14071 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782240110.239343:0:16089:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f46ff800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16089:1868813758997632:0@lo:104: 00000100:00100000:3.0:1782240110.239365:0:16089:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782240110.239374:0:16089:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c8460d80 going to sleep for 11 seconds 00000100:00100000:1.0:1782240110.239550:0:14059:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1782240110.239562:0:14059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758997376 00000100:00100000:1.0:1782240110.239567:0:14059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758997376 00000100:00100000:1.0:1782240110.239599:0:14059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758997504 00000100:00100000:1.0:1782240110.239601:0:14059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758997504 00000100:00100000:1.0:1782240110.239609:0:14059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758997632 00000100:00100000:1.0:1782240110.239610:0:14059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758997632 00000100:00100000:1.0:1782240110.239622:0:14059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782240110.239628:0:14059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f46fce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+5:16089:x1868813758997376:12345-0@lo:104: 00010000:00010000:1.0:1782240110.239639:0:14059:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e38c00/0x8c5345f1c1ec5f25 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c5345f1c1ec5f2c expref: -99 pid: 15381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240110.239692:0:14059:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782240110.239698:0:14059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f46fce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+5:16089:x1868813758997376:12345-0@lo:104: Request processed in 70us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1782240110.239705:0:14059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782240110.239720:0:14059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1782240110.239726:0:14059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f46fe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+4:16089:x1868813758997504:12345-0@lo:104: 00010000:00010000:1.0:1782240110.239733:0:14059:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.132@tcp lock: ffff9bb5ee29f600/0x8c5345f1c1ec5df1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c5345f1c1ec5df8 expref: -99 pid: 14710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240110.239795:0:14059:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1782240110.239800:0:14059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f46fe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+4:16089:x1868813758997504:12345-0@lo:104: Request processed in 75us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1782240110.239813:0:14059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1782240110.239826:0:14059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1782240110.239832:0:14059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ffdd6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+3:16089:x1868813758997632:12345-0@lo:104: 00010000:00010000:1.0:1782240110.239839:0:14059:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e27000/0x8c5345f1c1ec5da4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c5345f1c1ec5dab expref: -99 pid: 14073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240110.239867:0:14059:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1782240110.239871:0:14059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ffdd6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+3:16089:x1868813758997632:12345-0@lo:104: Request processed in 40us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1782240110.239876:0:14059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1782240110.239913:0:14064:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1782240110.239918:0:14064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e38c00/0x8c5345f1c1ec5f25 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c5345f1c1ec5f2c expref: -99 pid: 15381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240110.239924:0:14064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f7e38c00 already unused, calling callback (ffffffffc1d0cc20) 10000000:00010000:1.0:1782240110.239928:0:14064:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e38c00/0x8c5345f1c1ec5f25 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8c5345f1c1ec5f2c expref: -99 pid: 15381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240110.239935:0:14064:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e38c00/0x8c5345f1c1ec5f25 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8c5345f1c1ec5f2c expref: -99 pid: 15381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782240110.239942:0:14064:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e38c00/0x8c5345f1c1ec5f25 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8c5345f1c1ec5f2c expref: -99 pid: 15381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782240110.239959:0:14064:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1782240110.239986:0:14064:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e38c00/0x8c5345f1c1ec5f25 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c5345f1c1ec5f2c expref: -99 pid: 15381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240110.239992:0:14064:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782240110.240019:0:14064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e38c00/0x8c5345f1c1ec5f25 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c5345f1c1ec5f2c expref: -99 pid: 15381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240110.240027:0:14064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e38c00/0x8c5345f1c1ec5f25 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c5345f1c1ec5f2c expref: -99 pid: 15381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240110.240039:0:14064:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782240110.240041:0:14064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.132@tcp lock: ffff9bb5ee29f600/0x8c5345f1c1ec5df1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c5345f1c1ec5df8 expref: -99 pid: 14710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240110.240047:0:14064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5ee29f600 already unused, calling callback (ffffffffc1d0cc20) 10000000:00010000:1.0:1782240110.240049:0:14064:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.132@tcp lock: ffff9bb5ee29f600/0x8c5345f1c1ec5df1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8c5345f1c1ec5df8 expref: -99 pid: 14710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240110.240055:0:14064:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.132@tcp lock: ffff9bb5ee29f600/0x8c5345f1c1ec5df1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8c5345f1c1ec5df8 expref: -99 pid: 14710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782240110.240061:0:14064:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.132@tcp lock: ffff9bb5ee29f600/0x8c5345f1c1ec5df1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8c5345f1c1ec5df8 expref: -99 pid: 14710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782240110.240066:0:14064:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1782240110.240079:0:14064:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.132@tcp lock: ffff9bb5ee29f600/0x8c5345f1c1ec5df1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c5345f1c1ec5df8 expref: -99 pid: 14710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240110.240085:0:14064:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782240110.240098:0:14064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.132@tcp lock: ffff9bb5ee29f600/0x8c5345f1c1ec5df1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c5345f1c1ec5df8 expref: -99 pid: 14710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240110.240104:0:14064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.132@tcp lock: ffff9bb5ee29f600/0x8c5345f1c1ec5df1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c5345f1c1ec5df8 expref: -99 pid: 14710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240110.240123:0:14064:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782240110.240126:0:14064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e27000/0x8c5345f1c1ec5da4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c5345f1c1ec5dab expref: -99 pid: 14073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240110.240132:0:14064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f7e27000 already unused, calling callback (ffffffffc1d0cc20) 10000000:00010000:1.0:1782240110.240134:0:14064:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e27000/0x8c5345f1c1ec5da4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8c5345f1c1ec5dab expref: -99 pid: 14073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240110.240141:0:14064:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e27000/0x8c5345f1c1ec5da4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8c5345f1c1ec5dab expref: -99 pid: 14073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782240110.240148:0:14064:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e27000/0x8c5345f1c1ec5da4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8c5345f1c1ec5dab expref: -99 pid: 14073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782240110.240153:0:14064:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1782240110.240167:0:14064:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e27000/0x8c5345f1c1ec5da4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c5345f1c1ec5dab expref: -99 pid: 14073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240110.240173:0:14064:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782240110.240179:0:14064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e27000/0x8c5345f1c1ec5da4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c5345f1c1ec5dab expref: -99 pid: 14073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240110.240185:0:14064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e27000/0x8c5345f1c1ec5da4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c5345f1c1ec5dab expref: -99 pid: 14073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240110.240197:0:14064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782240110.240199:0:14064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782240110.240200:0:14064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782240110.240220:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f48c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:3305:1868813758997760:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782240110.240254:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782240110.240292:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f48c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:3306:1868813758997888:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782240110.240313:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782240110.240328:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782240110.240333:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f48c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:3306:1868813758998016:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782240110.240355:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782240110.240630:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782240110.240640:0:14063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758997760 00000100:00100000:0.0:1782240110.240645:0:14063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758997760 00010000:00010000:0.0:1782240110.240666:0:14063:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bb5c0030000/0x8c5345f1c1ec5f2c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c5345f1c1ec5f25 expref: 19 pid: 14071 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782240110.240680:0:14063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758997888 00000100:00100000:0.0:1782240110.240683:0:14063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758997888 00010000:00010000:0.0:1782240110.240692:0:14063:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bb5f7e38400/0x8c5345f1c1ec5df8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c5345f1c1ec5df1 expref: 20 pid: 14071 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782240110.240702:0:14063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758998016 00000100:00100000:0.0:1782240110.240704:0:14063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758998016 00010000:00010000:0.0:1782240110.240713:0:14063:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bb5ee29f400/0x8c5345f1c1ec5dab lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c5345f1c1ec5da4 expref: 21 pid: 14071 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782240110.240725:0:14063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1782240110.240730:0:14063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+21:3305:x1868813758997760:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782240110.240740:0:14063:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782240110.240744:0:14063:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bb5c0030000/0x8c5345f1c1ec5f2c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c5345f1c1ec5f25 expref: 21 pid: 14071 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240110.240776:0:14063:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bb5c0030000/0x8c5345f1c1ec5f2c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8c5345f1c1ec5f25 expref: 21 pid: 14071 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240110.240791:0:14063:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782240110.240824:0:14063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+21:3305:x1868813758997760:12345-0@lo:103:ldlm_bl.0 Request processed in 93us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1782240110.240831:0:14063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1782240110.240844:0:14063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1782240110.240850:0:14063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+20:3306:x1868813758997888:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782240110.240864:0:14063:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782240110.240868:0:14063:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bb5f7e38400/0x8c5345f1c1ec5df8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c5345f1c1ec5df1 expref: 20 pid: 14071 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240110.240876:0:14063:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bb5f7e38400/0x8c5345f1c1ec5df8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8c5345f1c1ec5df1 expref: 20 pid: 14071 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240110.240885:0:14063:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782240110.240912:0:14063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+20:3306:x1868813758997888:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1782240110.240918:0:14063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1782240110.240929:0:14063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1782240110.240935:0:14063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5edc9d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+19:3306:x1868813758998016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782240110.240941:0:14063:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782240110.240956:0:14063:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bb5ee29f400/0x8c5345f1c1ec5dab lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8c5345f1c1ec5da4 expref: 19 pid: 14071 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240110.240965:0:14063:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bb5ee29f400/0x8c5345f1c1ec5dab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8c5345f1c1ec5da4 expref: 19 pid: 14071 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240110.240974:0:14063:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782240110.240995:0:14063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5edc9d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+19:3306:x1868813758998016:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1782240110.241001:0:14063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1782240110.241051:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f48c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:3306:1868813758998016:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782240110.241059:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f48c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:3306:1868813758997888:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782240110.241785:0:16089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb5c0030000/0x8c5345f1c1ec5f2c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8c5345f1c1ec5f25 expref: 18 pid: 14071 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782240110.241798:0:16089:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f4895500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16089:1868813758997376:0@lo:104: 00010000:00010000:3.0:1782240110.241809:0:16089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb5f7e38400/0x8c5345f1c1ec5df8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8c5345f1c1ec5df1 expref: 17 pid: 14071 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782240110.241830:0:16089:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f46fc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16089:1868813758997504:0@lo:104: 00010000:00010000:3.0:1782240110.241843:0:16089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb5ee29f400/0x8c5345f1c1ec5dab lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8c5345f1c1ec5da4 expref: 16 pid: 14071 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782240110.241851:0:16089:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f46ff800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16089:1868813758997632:0@lo:104: 00000100:00100000:1.0:1782240110.241931:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f48c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:3305:1868813758997760:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782240110.250863:0:16089:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f4894000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16089:1868813758997120:192.168.203.32@tcp:104: 00000100:00100000:0.0:1782240110.250895:0:16089:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f4895180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16089:1868813758997248:192.168.203.32@tcp:104: 00010000:00010000:0.0:1782240110.250928:0:16089:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bb5f7e26200/0x8c5345f1c1ec60b4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782240110.251694:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782240110.251806:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782240110.251881:0:14061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738032640 00000100:00100000:3.0:1782240110.251889:0:14061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738032640 00010000:00010000:3.0:1782240110.251920:0:14061:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bb4c2018600/0x8c5345f1c1ec608a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e900 expref: 13 pid: 14070 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782240110.251962:0:14061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738032768 00000100:00100000:3.0:1782240110.251965:0:14061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738032768 00010000:00010000:3.0:1782240110.251977:0:14061:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bb5c0031a00/0x8c5345f1c1ec6052 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e89e expref: 14 pid: 14070 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782240110.251991:0:14061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 7 00000100:00100000:3.0:1782240110.251999:0:14061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5eddf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:94a0379e-2f28-4d53-90a1-f8718289b741+14:2344:x1868813738032640:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782240110.252013:0:14061:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782240110.252019:0:14061:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bb4c2018600/0x8c5345f1c1ec608a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e900 expref: 14 pid: 14070 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240110.252029:0:14061:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bb4c2018600/0x8c5345f1c1ec608a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e900 expref: 14 pid: 14070 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240110.252045:0:14061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb4c2018600/0x8c5345f1c1ec608a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e900 expref: 14 pid: 14070 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240110.252059:0:14061:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782240110.252119:0:14061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5eddf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:94a0379e-2f28-4d53-90a1-f8718289b741+13:2344:x1868813738032640:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 118us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1782240110.252127:0:14061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 7 00000100:00100000:3.0:1782240110.252145:0:14061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 8 00000100:00100000:3.0:1782240110.252153:0:14061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5eddf5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:94a0379e-2f28-4d53-90a1-f8718289b741+12:2344:x1868813738032768:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782240110.252160:0:14061:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782240110.252164:0:14061:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bb5c0031a00/0x8c5345f1c1ec6052 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e89e expref: 12 pid: 14070 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240110.252174:0:14061:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bb5c0031a00/0x8c5345f1c1ec6052 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e89e expref: 12 pid: 14070 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240110.252183:0:14061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb5c0031a00/0x8c5345f1c1ec6052 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e89e expref: 12 pid: 14070 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240110.252195:0:14061:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bb5f7e26200/0x8c5345f1c1ec60b4 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240110.252204:0:14061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb5f7e26200/0x8c5345f1c1ec60b4 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240110.252219:0:14061:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bb5f7e26200/0x8c5345f1c1ec60b4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240110.252226:0:14061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bb5f7e26200/0x8c5345f1c1ec60b4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240110.252233:0:14061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bb5f7e26200/0x8c5345f1c1ec60b4 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240110.252238:0:14061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bb5f7e26200/0x8c5345f1c1ec60b4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240110.252251:0:14061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f7e26200 already unused, calling callback (ffffffffc1728ce0) 00010000:00010000:3.0:1782240110.252256:0:14061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bb5f7e26200/0x8c5345f1c1ec60b4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240110.252264:0:14061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bb5f7e26200/0x8c5345f1c1ec60b4 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240110.252276:0:14061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bb5f7e26200/0x8c5345f1c1ec60b4 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240110.252286:0:14061:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782240110.252307:0:14061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5eddf5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:94a0379e-2f28-4d53-90a1-f8718289b741+11:2344:x1868813738032768:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 155us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1782240110.252314:0:14061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 8 00010000:00010000:0.0:1782240110.252497:0:16089:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bb5f7e26200/0x8c5345f1c1ec60b4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240110.252506:0:16089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bb5f7e26200/0x8c5345f1c1ec60b4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240110.252512:0:16089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb5f7e26200/0x8c5345f1c1ec60b4 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782240110.879388:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb6018cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1868813758998144:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782240110.879458:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782240110.879732:0:14715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758998144 00000100:00100000:1.0:1782240110.879741:0:14715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758998144 00000100:00100000:1.0:1782240110.879826:0:14715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1782240110.879836:0:14715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5eddf4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1868813758998144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782240110.879872:0:14715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1782240110.881332:0:14072:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782240110.881678:0:14715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5eddf4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1868813758998144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1839us (2216us total) trans 0 rc 0/0 00000100:00100000:1.0:1782240110.881690:0:14715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1782240110.886138:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb6018cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1868813758998144:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1782240111.071811:0:14064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1782240111.456919:0:14073:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1782240111.457003:0:14073:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9bb5d1a15800 from 10 10000000:01000000:1.0:1782240111.457009:0:14073:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1782240111.457062:0:14073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e38800/0x8c5345f1c1ec60bb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240111.457075:0:14073:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e38800/0x8c5345f1c1ec60bb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240111.457086:0:14073:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e38800/0x8c5345f1c1ec60bb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782240111.457124:0:14073:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f48c2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14073:1868813758998272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782240111.457189:0:14073:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782240111.457247:0:14073:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c2ff9600 going to sleep for 11 seconds 00000100:00100000:1.0:1782240111.457276:0:14070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758998272 00000100:00100000:1.0:1782240111.457283:0:14070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758998272 00000100:00100000:1.0:1782240111.457334:0:14070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1782240111.457345:0:14070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d81c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+16:14073:x1868813758998272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782240111.457359:0:14070:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782240111.457374:0:14070:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb5f7e39a00/0x8c5345f1c1ec60c2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c5345f1c1ec60bb expref: -99 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240111.457398:0:14070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb5f7e39a00/0x8c5345f1c1ec60c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c5345f1c1ec60bb expref: 17 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240111.457408:0:14070:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb5f7e39a00/0x8c5345f1c1ec60c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c5345f1c1ec60bb expref: 17 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240111.457416:0:14070:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5f7e39a00, rc 0) 00000100:00100000:1.0:1782240111.457461:0:14070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d81c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+17:14073:x1868813758998272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1782240111.457468:0:14070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1782240111.457521:0:14073:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f48c2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14073:1868813758998272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782240111.458049:0:14073:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e38800/0x8c5345f1c1ec60bb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec60c2 expref: -99 pid: 14073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240111.458062:0:14073:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e38800/0x8c5345f1c1ec60bb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c5345f1c1ec60c2 expref: -99 pid: 14073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782240111.458147:0:14073:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f48c2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14073:1868813758998400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782240111.458181:0:14073:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782240111.458214:0:14073:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c2ff9600 going to sleep for 11 seconds 00000100:00100000:1.0:1782240111.458231:0:14071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758998400 00000100:00100000:1.0:1782240111.458235:0:14071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758998400 00000100:00100000:1.0:1782240111.458266:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1782240111.458274:0:14071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d81c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+17:14073:x1868813758998400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782240111.458564:0:14071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d81c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+17:14073:x1868813758998400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 291us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1782240111.458573:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1782240111.458631:0:14073:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f48c2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14073:1868813758998400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782240111.458662:0:14073:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f48c2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14073:1868813758998528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782240111.458701:0:14073:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782240111.458718:0:14073:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c2ff9600 going to sleep for 11 seconds 00000100:00100000:1.0:1782240111.458731:0:14068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758998528 00000100:00100000:1.0:1782240111.458735:0:14068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758998528 00000100:00100000:1.0:1782240111.458868:0:14068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1782240111.458877:0:14068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d81c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+17:14073:x1868813758998528:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782240111.459089:0:14068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d81c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+17:14073:x1868813758998528:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 213us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1782240111.459097:0:14068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1782240111.459147:0:14073:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f48c2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14073:1868813758998528:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1782240111.461561:0:16153:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1782240111.461727:0:14073:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1782240111.461858:0:14073:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1782240111.461870:0:14073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e38800/0x8c5345f1c1ec60bb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec60c2 expref: -99 pid: 14073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240111.461883:0:14073:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e38800/0x8c5345f1c1ec60bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec60c2 expref: -99 pid: 14073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782240111.461895:0:14073:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1782240111.461899:0:14073:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9bb5f499d800 from 10 10000000:01000000:1.0:1782240111.461902:0:14073:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1782240111.462017:0:14073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e38c00/0x8c5345f1c1ec60c9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240111.462028:0:14073:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e38c00/0x8c5345f1c1ec60c9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240111.462039:0:14073:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e38c00/0x8c5345f1c1ec60c9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782240111.462064:0:14073:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f48c2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14073:1868813758998656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782240111.462124:0:14073:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782240111.462218:0:14070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758998656 00000100:00100000:3.0:1782240111.462225:0:14070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758998656 00000100:00100000:1.0:1782240111.462234:0:14073:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5d1bb3900 going to sleep for 11 seconds 00000100:00100000:3.0:1782240111.462267:0:14070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1782240111.462277:0:14070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5d81c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+17:14073:x1868813758998656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782240111.462290:0:14070:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782240111.462302:0:14070:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb5f7e27800/0x8c5345f1c1ec60d0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c5345f1c1ec60c9 expref: -99 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240111.462324:0:14070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb5f7e27800/0x8c5345f1c1ec60d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c5345f1c1ec60c9 expref: 18 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240111.462334:0:14070:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb5f7e27800/0x8c5345f1c1ec60d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c5345f1c1ec60c9 expref: 18 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240111.462351:0:14070:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5f7e27800, rc 0) 00000100:00100000:3.0:1782240111.462389:0:14070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5d81c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+18:14073:x1868813758998656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1782240111.462397:0:14070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1782240111.462443:0:14073:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f48c2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14073:1868813758998656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782240111.462457:0:14073:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e38c00/0x8c5345f1c1ec60c9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec60d0 expref: -99 pid: 14073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240111.462466:0:14073:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e38c00/0x8c5345f1c1ec60c9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c5345f1c1ec60d0 expref: -99 pid: 14073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782240111.462513:0:14073:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f46fea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14073:1868813758998784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782240111.462536:0:14073:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782240111.462549:0:14073:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c8460840 going to sleep for 11 seconds 00000100:00100000:3.0:1782240111.462560:0:14071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758998784 00000100:00100000:3.0:1782240111.462563:0:14071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758998784 00000100:00100000:3.0:1782240111.462587:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1782240111.462596:0:14071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc0bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+18:14073:x1868813758998784:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782240111.463041:0:14071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc0bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+18:14073:x1868813758998784:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 445us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1782240111.463048:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1782240111.463086:0:14073:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f46fea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14073:1868813758998784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782240111.463115:0:14073:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f46fea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14073:1868813758998912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782240111.463148:0:14073:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782240111.463172:0:14073:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c8460840 going to sleep for 11 seconds 00000100:00100000:3.0:1782240111.463183:0:14068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758998912 00000100:00100000:3.0:1782240111.463186:0:14068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758998912 00000100:00100000:3.0:1782240111.463207:0:14068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1782240111.463213:0:14068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc0bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+18:14073:x1868813758998912:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782240111.463365:0:14068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc0bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+18:14073:x1868813758998912:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 151us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1782240111.463374:0:14068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1782240111.463416:0:14073:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f46fea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14073:1868813758998912:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1782240111.464213:0:16154:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1782240111.464263:0:14073:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1782240111.464278:0:14073:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1782240111.464286:0:14073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e38c00/0x8c5345f1c1ec60c9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec60d0 expref: -99 pid: 14073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240111.464295:0:14073:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e38c00/0x8c5345f1c1ec60c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec60d0 expref: -99 pid: 14073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782240111.464304:0:14073:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1782240111.464306:0:14073:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9bb5d204d000 from 10 10000000:01000000:3.0:1782240111.464309:0:14073:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1782240111.464332:0:14073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e26600/0x8c5345f1c1ec60d7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240111.464340:0:14073:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e26600/0x8c5345f1c1ec60d7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240111.464349:0:14073:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e26600/0x8c5345f1c1ec60d7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782240111.464375:0:14073:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f46fea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14073:1868813758999040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782240111.464411:0:14073:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782240111.464438:0:14073:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c8460180 going to sleep for 11 seconds 00000100:00100000:3.0:1782240111.464454:0:14070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758999040 00000100:00100000:3.0:1782240111.464457:0:14070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758999040 00000100:00100000:3.0:1782240111.464491:0:14070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1782240111.464500:0:14070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc0bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+18:14073:x1868813758999040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782240111.464510:0:14070:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782240111.464521:0:14070:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb5f7e26800/0x8c5345f1c1ec60de lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8c5345f1c1ec60d7 expref: -99 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240111.464539:0:14070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb5f7e26800/0x8c5345f1c1ec60de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8c5345f1c1ec60d7 expref: 19 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240111.464549:0:14070:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb5f7e26800/0x8c5345f1c1ec60de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8c5345f1c1ec60d7 expref: 19 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240111.464558:0:14070:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5f7e26800, rc 0) 00000100:00100000:3.0:1782240111.464595:0:14070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc0bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+19:14073:x1868813758999040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 96us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1782240111.464601:0:14070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1782240111.464642:0:14073:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f46fea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14073:1868813758999040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782240111.464657:0:14073:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e26600/0x8c5345f1c1ec60d7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec60de expref: -99 pid: 14073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240111.464666:0:14073:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e26600/0x8c5345f1c1ec60d7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c5345f1c1ec60de expref: -99 pid: 14073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782240111.464726:0:14073:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f46fea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14073:1868813758999168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782240111.464857:0:14073:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782240111.464878:0:14073:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c8460180 going to sleep for 11 seconds 00000100:00100000:3.0:1782240111.464893:0:14071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758999168 00000100:00100000:3.0:1782240111.464897:0:14071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758999168 00000100:00100000:3.0:1782240111.464999:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1782240111.465012:0:14071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc0be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+19:14073:x1868813758999168:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782240111.465248:0:14071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc0be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+19:14073:x1868813758999168:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 236us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1782240111.465256:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1782240111.465286:0:14073:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f46fea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14073:1868813758999168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782240111.465312:0:14073:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f46fea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14073:1868813758999296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782240111.465348:0:14073:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782240111.465361:0:14073:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c8460180 going to sleep for 11 seconds 00000100:00100000:3.0:1782240111.465375:0:14068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758999296 00000100:00100000:3.0:1782240111.465379:0:14068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758999296 00000100:00100000:3.0:1782240111.465401:0:14068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1782240111.465409:0:14068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ee8ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+19:14073:x1868813758999296:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782240111.465556:0:14068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ee8ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+19:14073:x1868813758999296:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 148us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1782240111.465563:0:14068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1782240111.465607:0:14073:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f46fea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:14073:1868813758999296:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1782240111.475172:0:16155:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1782240111.475436:0:14073:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1782240111.475459:0:14073:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1782240111.475475:0:14073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e26600/0x8c5345f1c1ec60d7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec60de expref: -99 pid: 14073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240111.475488:0:14073:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.132@tcp lock: ffff9bb5f7e26600/0x8c5345f1c1ec60d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c5345f1c1ec60de expref: -99 pid: 14073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782240111.957546:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782240111.957608:0:14070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738032896 00000100:00100000:1.0:1782240111.957619:0:14070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738032896 00000100:00100000:1.0:1782240111.957668:0:14070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 115 00000100:00100000:1.0:1782240111.957679:0:14070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ee8ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94a0379e-2f28-4d53-90a1-f8718289b741+11:13708:x1868813738032896:12345-192.168.203.32@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782240111.957695:0:14070:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782240111.957712:0:14070:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb5f7e39e00/0x8c5345f1c1ec60e5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e931 expref: -99 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240111.957775:0:14070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb5f7e39e00/0x8c5345f1c1ec60e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e931 expref: 12 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240111.957787:0:14070:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb5f7e39e00/0x8c5345f1c1ec60e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e931 expref: 12 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240111.957797:0:14070:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5f7e39e00, rc 0) 00000100:00100000:1.0:1782240111.957858:0:14070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ee8ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94a0379e-2f28-4d53-90a1-f8718289b741+12:13708:x1868813738032896:12345-192.168.203.32@tcp:101:ll_cfg_requeue.0 Request processed in 181us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1782240111.957867:0:14070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 115 00000100:00100000:3.0:1782240111.966206:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782240111.970377:0:14071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738033024 00000100:00100000:0.0:1782240111.970462:0:14071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738033024 00000100:00100000:0.0:1782240111.970528:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 116 00000100:00100000:0.0:1782240111.970538:0:14071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ee8ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94a0379e-2f28-4d53-90a1-f8718289b741+12:13708:x1868813738033024:12345-192.168.203.32@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782240111.970828:0:14071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ee8ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94a0379e-2f28-4d53-90a1-f8718289b741+12:13708:x1868813738033024:12345-192.168.203.32@tcp:501:ll_cfg_requeue.0 Request processed in 290us (4631us total) trans 0 rc 0/0 00000100:00100000:0.0:1782240111.970837:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 116 00000100:00100000:1.0:1782240111.985340:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782240111.986391:0:14068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738033152 00000100:00100000:3.0:1782240111.986405:0:14068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738033152 00000100:00100000:3.0:1782240111.986507:0:14068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 117 00000100:00100000:3.0:1782240111.986517:0:14068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ee8eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94a0379e-2f28-4d53-90a1-f8718289b741+12:13708:x1868813738033152:12345-192.168.203.32@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782240111.986742:0:14068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ee8eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94a0379e-2f28-4d53-90a1-f8718289b741+12:13708:x1868813738033152:12345-192.168.203.32@tcp:503:ll_cfg_requeue.0 Request processed in 225us (1410us total) trans 0 rc 0/0 00000100:00100000:3.0:1782240111.986770:0:14068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 117 00000100:00100000:0.0:1782240112.001944:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782240112.002197:0:14070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738033280 00000100:00100000:2.0:1782240112.002219:0:14070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738033280 00000100:00100000:2.0:1782240112.002275:0:14070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 118 00000100:00100000:2.0:1782240112.002285:0:14070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ee8ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94a0379e-2f28-4d53-90a1-f8718289b741+12:13708:x1868813738033280:12345-192.168.203.32@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782240112.002302:0:14070:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782240112.002319:0:14070:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb4c2018600/0x8c5345f1c1ec60ec lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e938 expref: -99 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240112.002345:0:14070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb4c2018600/0x8c5345f1c1ec60ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e938 expref: 13 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240112.002355:0:14070:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb4c2018600/0x8c5345f1c1ec60ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e938 expref: 13 pid: 14070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240112.002365:0:14070:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb4c2018600, rc 0) 00000100:00100000:2.0:1782240112.002425:0:14070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ee8ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94a0379e-2f28-4d53-90a1-f8718289b741+13:13708:x1868813738033280:12345-192.168.203.32@tcp:101:ll_cfg_requeue.0 Request processed in 141us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1782240112.002433:0:14070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 118 00000100:00100000:2.0:1782240112.012100:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782240112.012191:0:14068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738033408 00000100:00100000:0.0:1782240112.012202:0:14068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738033408 00000100:00100000:0.0:1782240112.012267:0:14068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 119 00000100:00100000:0.0:1782240112.012276:0:14068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ee8ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94a0379e-2f28-4d53-90a1-f8718289b741+13:13708:x1868813738033408:12345-192.168.203.32@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782240112.012541:0:14068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ee8ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94a0379e-2f28-4d53-90a1-f8718289b741+13:13708:x1868813738033408:12345-192.168.203.32@tcp:501:ll_cfg_requeue.0 Request processed in 265us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1782240112.012550:0:14068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 119 00000100:00100000:1.0:1782240112.023351:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782240112.023450:0:14071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738033536 00000100:00100000:0.0:1782240112.023460:0:14071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738033536 00000100:00100000:0.0:1782240112.023550:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 120 00000100:00100000:0.0:1782240112.023562:0:14071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ee8ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94a0379e-2f28-4d53-90a1-f8718289b741+13:13708:x1868813738033536:12345-192.168.203.32@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782240112.023909:0:14071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ee8ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94a0379e-2f28-4d53-90a1-f8718289b741+13:13708:x1868813738033536:12345-192.168.203.32@tcp:503:ll_cfg_requeue.0 Request processed in 348us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1782240112.023916:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 120 00010000:00010000:0.0:1782240112.095504:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782240112.415193:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782240112.415232:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f48c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1868813758999424:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782240112.415299:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782240112.415491:0:14716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758999424 00000100:00100000:1.0:1782240112.415500:0:14716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758999424 00000100:00100000:1.0:1782240112.415568:0:14716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1782240112.415578:0:14716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5eddf7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1868813758999424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782240112.415614:0:14716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782240112.415661:0:14716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5eddf7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1868813758999424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1782240112.415668:0:14716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1782240112.416153:0:14072:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782240112.416189:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f48c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1868813758999424:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782240112.418429:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5eddf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1868813758999680:0@lo:400:kworker.0 00000100:00100000:3.0:1782240112.418500:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782240112.418555:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1782240112.418561:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5eddf4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:3307:1868813758999552:0@lo:400:kworker.0 00000100:00100000:3.0:1782240112.418590:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782240112.418611:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5eddf4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1868813759000064:0@lo:400:kworker.0 00000100:00100000:3.0:1782240112.418635:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782240112.418659:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5eddf6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1868813758999936:0@lo:400:kworker.0 00000100:00100000:3.0:1782240112.418681:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782240112.418697:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782240112.418703:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5eddf7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1868813758999808:0@lo:400:kworker.0 00000100:00100000:3.0:1782240112.418723:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782240112.419701:0:14714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758999680 00000100:00100000:0.0:1782240112.419715:0:14714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758999680 00000100:00100000:0.0:1782240112.419828:0:14714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1782240112.419839:0:14714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f46fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1868813758999680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782240112.419911:0:14714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f46fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1868813758999680:12345-0@lo:400:kworker.0 Request processed in 74us (1409us total) trans 0 rc 0/0 00000100:00100000:0.0:1782240112.419919:0:14714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1782240112.420133:0:14070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758999552 00000100:00100000:2.0:1782240112.420139:0:14070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758999552 00000100:00100000:2.0:1782240112.420171:0:14070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1782240112.420177:0:14070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ee8ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+19:3307:x1868813758999552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782240112.420255:0:14070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ee8ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+19:3307:x1868813758999552:12345-0@lo:400:kworker.0 Request processed in 78us (1664us total) trans 0 rc 0/0 00000100:00100000:2.0:1782240112.420262:0:14070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1782240112.420294:0:15850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813759000064 00000100:00100000:2.0:1782240112.420297:0:15850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813759000064 00000100:00100000:2.0:1782240112.420322:0:15850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758999936 00000100:00100000:2.0:1782240112.420325:0:15850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758999936 00000100:00100000:2.0:1782240112.420350:0:15850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813758999808 00000100:00100000:2.0:1782240112.420353:0:15850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813758999808 00000100:00100000:2.0:1782240112.420366:0:15850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1782240112.420372:0:15850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f46fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1868813759000064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782240112.420405:0:15850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f46fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1868813759000064:12345-0@lo:400:kworker.0 Request processed in 32us (1769us total) trans 0 rc 0/0 00000100:00100000:2.0:1782240112.420411:0:15850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1782240112.420422:0:15850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1782240112.420428:0:15850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f46fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1868813758999936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782240112.420458:0:15850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f46fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1868813758999936:12345-0@lo:400:kworker.0 Request processed in 31us (1777us total) trans 0 rc 0/0 00000100:00100000:2.0:1782240112.420465:0:15850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1782240112.420476:0:15850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1782240112.420482:0:15850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f46ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1868813758999808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782240112.420508:0:15850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f46ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1868813758999808:12345-0@lo:400:kworker.0 Request processed in 26us (1783us total) trans 0 rc 0/0 00000100:00100000:2.0:1782240112.420514:0:15850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:1.0:1782240112.421191:0:14072:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782240112.421208:0:14072:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782240112.421744:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5eddf7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1868813758999808:0@lo:400:kworker.0 00000100:00100000:3.0:1782240112.421807:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5eddf6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1868813758999936:0@lo:400:kworker.0 00000100:00100000:3.0:1782240112.421854:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5eddf4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:3307:1868813758999552:0@lo:400:kworker.0 00000100:00100000:3.0:1782240112.421867:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5eddf4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1868813759000064:0@lo:400:kworker.0 00000100:00100000:3.0:1782240112.421896:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5eddf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1868813758999680:0@lo:400:kworker.0 00010000:00010000:1.0:1782240113.119852:0:14064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782240113.604044:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782240113.604148:0:15850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738033664 00000100:00100000:2.0:1782240113.604158:0:15850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738033664 00000100:00100000:2.0:1782240113.604243:0:15850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 15 00000100:00100000:2.0:1782240113.604273:0:15850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5eddf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+6:14365:x1868813738033664:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782240113.604384:0:15850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782240113.604413:0:15850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2018a00/0x8c5345f1c1ec60f3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e93f expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240113.604475:0:15850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019400/0x8c5345f1c1ec60fa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240113.604487:0:15850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019400/0x8c5345f1c1ec60fa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240113.604496:0:15850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019400/0x8c5345f1c1ec60fa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240113.604507:0:15850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2018000/0x8c5345f1c1ec6101 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240113.604513:0:15850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2018000/0x8c5345f1c1ec6101 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240113.604518:0:15850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2018000/0x8c5345f1c1ec6101 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1782240113.604899:0:14072:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1782240113.605366:0:15850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019e00/0x8c5345f1c1ec6108 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240113.605379:0:15850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019e00/0x8c5345f1c1ec6108 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240113.605387:0:15850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019e00/0x8c5345f1c1ec6108 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782240113.605483:0:15850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1782240113.605487:0:15850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1782240113.605577:0:15850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019e00/0x8c5345f1c1ec6108 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240113.605589:0:15850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019400/0x8c5345f1c1ec60fa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240113.605596:0:15850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019400/0x8c5345f1c1ec60fa lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240113.605602:0:15850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019400/0x8c5345f1c1ec60fa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240113.605609:0:15850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb4c2019400 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:2.0:1782240113.605612:0:15850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019400/0x8c5345f1c1ec60fa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240113.605619:0:15850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019400/0x8c5345f1c1ec60fa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240113.605630:0:15850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bb5cfd09400) 00010000:00010000:2.0:1782240113.605633:0:15850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782240113.605637:0:15850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019400/0x8c5345f1c1ec60fa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240113.605642:0:15850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019400/0x8c5345f1c1ec60fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240113.605654:0:15850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2018000/0x8c5345f1c1ec6101 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240113.605669:0:15850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2018000/0x8c5345f1c1ec6101 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240113.605674:0:15850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2018000/0x8c5345f1c1ec6101 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240113.605678:0:15850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb4c2018000 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:2.0:1782240113.605681:0:15850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2018000/0x8c5345f1c1ec6101 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240113.605686:0:15850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2018000/0x8c5345f1c1ec6101 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240113.605693:0:15850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9bb5c2e3a200) 00010000:00010000:2.0:1782240113.605695:0:15850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782240113.605697:0:15850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2018000/0x8c5345f1c1ec6101 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240113.605702:0:15850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2018000/0x8c5345f1c1ec6101 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240113.605733:0:15850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2018a00/0x8c5345f1c1ec60f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e93f expref: 8 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240113.605745:0:15850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019e00/0x8c5345f1c1ec6108 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e93f expref: 7 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240113.605835:0:15850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9bb5c2e3a400) 00010000:00010000:2.0:1782240113.605838:0:15850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782240113.605847:0:15850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb4c2019e00, rc 0) 00000100:00100000:2.0:1782240113.605912:0:15850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5eddf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+7:14365:x1868813738033664:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 1642us (1876us total) trans 0 rc 0/0 00000100:00100000:2.0:1782240113.605920:0:15850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 15 00000100:00100000:1.0:1782240113.611632:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782240113.611723:0:14078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738033920 00000100:00100000:2.0:1782240113.611733:0:14078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738033920 00000100:00100000:2.0:1782240113.611814:0:14078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 16 00000100:00100000:2.0:1782240113.611823:0:14078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+7:14365:x1868813738033920:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782240113.611841:0:14078:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782240113.611859:0:14078:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2018a00/0x8c5345f1c1ec610f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e946 expref: -99 pid: 14078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240113.611934:0:14078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2018000/0x8c5345f1c1ec6116 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240113.611948:0:14078:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2018000/0x8c5345f1c1ec6116 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240113.611959:0:14078:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2018000/0x8c5345f1c1ec6116 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240113.612031:0:14078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019400/0x8c5345f1c1ec611d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240113.612040:0:14078:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019400/0x8c5345f1c1ec611d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240113.612047:0:14078:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019400/0x8c5345f1c1ec611d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240113.612566:0:14078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019a00/0x8c5345f1c1ec6124 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240113.612581:0:14078:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019a00/0x8c5345f1c1ec6124 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240113.612588:0:14078:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019a00/0x8c5345f1c1ec6124 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782240113.612598:0:14078:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1782240113.612885:0:14078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2018000/0x8c5345f1c1ec6116 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240113.612893:0:14078:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2018000/0x8c5345f1c1ec6116 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240113.612898:0:14078:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2018000/0x8c5345f1c1ec6116 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240113.612904:0:14078:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb4c2018000 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:2.0:1782240113.612907:0:14078:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2018000/0x8c5345f1c1ec6116 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240113.612914:0:14078:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2018000/0x8c5345f1c1ec6116 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240113.612937:0:14078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9bb5c2e3a400) 00010000:00010000:2.0:1782240113.612940:0:14078:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782240113.612945:0:14078:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2018000/0x8c5345f1c1ec6116 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240113.612951:0:14078:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2018000/0x8c5345f1c1ec6116 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240113.612964:0:14078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019400/0x8c5345f1c1ec611d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240113.612975:0:14078:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019400/0x8c5345f1c1ec611d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240113.612981:0:14078:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019400/0x8c5345f1c1ec611d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240113.612986:0:14078:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb4c2019400 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:2.0:1782240113.612989:0:14078:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019400/0x8c5345f1c1ec611d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240113.612996:0:14078:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019400/0x8c5345f1c1ec611d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240113.613004:0:14078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9bb5c2e3a200) 00010000:00010000:2.0:1782240113.613007:0:14078:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782240113.613010:0:14078:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019400/0x8c5345f1c1ec611d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240113.613015:0:14078:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019400/0x8c5345f1c1ec611d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240113.613478:0:14078:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2018a00/0x8c5345f1c1ec610f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e946 expref: 10 pid: 14078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240113.613493:0:14078:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019a00/0x8c5345f1c1ec6124 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e946 expref: 9 pid: 14078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240113.613500:0:14078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bb5c2e3a600) 00010000:00010000:2.0:1782240113.613502:0:14078:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782240113.613510:0:14078:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb4c2019a00, rc 0) 00000100:00100000:2.0:1782240113.613584:0:14078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+9:14365:x1868813738033920:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 1761us (1960us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1782240113.613592:0:14078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 16 00000100:00100000:1.0:1782240113.619108:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782240113.619429:0:14077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738034048 00000100:00100000:3.0:1782240113.619439:0:14077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738034048 00000100:00100000:3.0:1782240113.619497:0:14077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 17 00000100:00100000:3.0:1782240113.619507:0:14077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+9:14365:x1868813738034048:12345-192.168.203.32@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1782240113.619618:0:14077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+9:14365:x1868813738034048:12345-192.168.203.32@tcp:59:lhsmtool_posix.0 Request processed in 112us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1782240113.619626:0:14077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 17 00000040:00080000:3.0:1782240113.695731:0:14110:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1782240113.727706:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782240113.727838:0:14078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738034176 00000100:00100000:2.0:1782240113.727848:0:14078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738034176 00000100:00100000:2.0:1782240113.727903:0:14078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 18 00000100:00100000:2.0:1782240113.727912:0:14078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+9:14371:x1868813738034176:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:2.0:1782240113.727940:0:14078:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782240113.727959:0:14078:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2018a00/0x8c5345f1c1ec6132 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e94d expref: -99 pid: 14078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240113.728025:0:14078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019400/0x8c5345f1c1ec6139 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240113.728056:0:14078:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019400/0x8c5345f1c1ec6139 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240113.728067:0:14078:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019400/0x8c5345f1c1ec6139 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240113.728082:0:14078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2018000/0x8c5345f1c1ec6140 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240113.728088:0:14078:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2018000/0x8c5345f1c1ec6140 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240113.728094:0:14078:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2018000/0x8c5345f1c1ec6140 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240113.728628:0:14078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019400/0x8c5345f1c1ec6139 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240113.728642:0:14078:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019400/0x8c5345f1c1ec6139 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240113.728649:0:14078:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019400/0x8c5345f1c1ec6139 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240113.728655:0:14078:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb4c2019400 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:2.0:1782240113.728660:0:14078:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019400/0x8c5345f1c1ec6139 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240113.728668:0:14078:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019400/0x8c5345f1c1ec6139 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240113.728680:0:14078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bb5cfd09400) 00010000:00010000:2.0:1782240113.728683:0:14078:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782240113.728687:0:14078:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019400/0x8c5345f1c1ec6139 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240113.728693:0:14078:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019400/0x8c5345f1c1ec6139 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240113.728705:0:14078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2018000/0x8c5345f1c1ec6140 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240113.728710:0:14078:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2018000/0x8c5345f1c1ec6140 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240113.728715:0:14078:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2018000/0x8c5345f1c1ec6140 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240113.728720:0:14078:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb4c2018000 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:2.0:1782240113.728728:0:14078:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2018000/0x8c5345f1c1ec6140 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240113.728734:0:14078:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2018000/0x8c5345f1c1ec6140 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240113.728742:0:14078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9bb5c2e3a200) 00010000:00010000:2.0:1782240113.728794:0:14078:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782240113.728798:0:14078:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2018000/0x8c5345f1c1ec6140 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240113.728804:0:14078:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2018000/0x8c5345f1c1ec6140 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240113.728839:0:14078:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2018a00/0x8c5345f1c1ec6132 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e94d expref: 10 pid: 14078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240113.728849:0:14078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bb5cfd09400) 00010000:00010000:2.0:1782240113.728851:0:14078:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782240113.728855:0:14078:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2018a00/0x8c5345f1c1ec6132 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e94d expref: 10 pid: 14078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240113.728865:0:14078:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb4c2018a00, rc 0) 00000100:00100000:2.0:1782240113.728936:0:14078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+9:14371:x1868813738034176:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 1024us (1238us total) trans 0 rc 301/301 00000100:00100000:2.0:1782240113.728945:0:14078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 18 00000100:00100000:1.0:1782240113.735250:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782240113.735373:0:14085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738034304 00000100:00100000:0.0:1782240113.735383:0:14085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738034304 00000100:00100000:0.0:1782240113.735472:0:14085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 0 00000100:00100000:0.0:1782240113.735483:0:14085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+9:14371:x1868813738034304:12345-192.168.203.32@tcp:700:lfs.0 00000100:00100000:0.0:1782240113.735571:0:14085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+9:14371:x1868813738034304:12345-192.168.203.32@tcp:700:lfs.0 Request processed in 89us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1782240113.735579:0:14085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 0 00000100:00100000:3.0:1782240113.737633:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782240113.737855:0:14077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738034560 00000100:00100000:0.0:1782240113.737865:0:14077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738034560 00000100:00100000:0.0:1782240113.737936:0:14077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 19 00000100:00100000:0.0:1782240113.737953:0:14077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f46fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+9:14371:x1868813738034560:12345-192.168.203.32@tcp:36:lfs.0 00010000:00010000:0.0:1782240113.738009:0:14077:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782240113.738034:0:14077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031000/0x8c5345f1c1ec6075 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e8c8 expref: 9 pid: 14077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240113.738053:0:14077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bb5cfd09400) 00010000:00010000:0.0:1782240113.738071:0:14077:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782240113.738512:0:14077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031a00/0x8c5345f1c1ec6147 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240113.738526:0:14077:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27e00/0x8c5345f1c1ec60ad lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e92a expref: 5 pid: 14076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240113.738535:0:14077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031a00/0x8c5345f1c1ec6147 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240113.738866:0:14077:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27e00/0x8c5345f1c1ec60ad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e92a expref: 5 pid: 14076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240113.738883:0:14077:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27e00/0x8c5345f1c1ec60ad lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e92a expref: 5 pid: 14076 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782240113.738898:0:14077:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5eddf4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14077:1868813759000192:192.168.203.32@tcp:104: 00000100:00100000:0.0:1782240113.739359:0:14077:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c2c79cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1782240113.743648:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782240113.744096:0:14077:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5eddf4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14077:1868813759000192:192.168.203.32@tcp:104: 00010000:00010000:0.0:1782240113.744259:0:14077:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031a00/0x8c5345f1c1ec6147 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782240113.744400:0:14061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738034688 00000100:00100000:3.0:1782240113.744408:0:14061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738034688 00010000:00010000:3.0:1782240113.744503:0:14061:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27e00/0x8c5345f1c1ec60ad lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e92a expref: 6 pid: 14076 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782240113.744549:0:14061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 9 00000100:00100000:3.0:1782240113.744559:0:14061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e915549f-7383-4873-bb08-ab4dbf0961dd+6:2345:x1868813738034688:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782240113.744574:0:14061:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782240113.744580:0:14061:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27e00/0x8c5345f1c1ec60ad lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e92a expref: 6 pid: 14076 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240113.744593:0:14061:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27e00/0x8c5345f1c1ec60ad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e92a expref: 6 pid: 14076 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240113.744614:0:14061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27e00/0x8c5345f1c1ec60ad lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e92a expref: 6 pid: 14076 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240113.744647:0:14061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bb5cfd09400) 00010000:00010000:3.0:1782240113.744651:0:14061:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031a00/0x8c5345f1c1ec6147 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240113.744660:0:14061:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031a00/0x8c5345f1c1ec6147 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240113.744668:0:14061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031a00/0x8c5345f1c1ec6147 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240113.744695:0:14061:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782240113.744777:0:14061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e915549f-7383-4873-bb08-ab4dbf0961dd+5:2345:x1868813738034688:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 219us (1137us total) trans 0 rc 0/0 00000100:00100000:3.0:1782240113.744785:0:14061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 9 00010000:00010000:0.0:1782240113.744949:0:14077:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031a00/0x8c5345f1c1ec6147 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240113.744957:0:14077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031a00/0x8c5345f1c1ec6147 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240113.744978:0:14077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030000/0x8c5345f1c1ec614e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240113.744999:0:14077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030000/0x8c5345f1c1ec614e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240113.745007:0:14077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030000/0x8c5345f1c1ec614e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1782240113.748840:0:14072:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:0.0:1782240113.748894:0:14077:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1782240113.748911:0:14077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031a00/0x8c5345f1c1ec6147 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240113.748931:0:14077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031a00/0x8c5345f1c1ec6147 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240113.748938:0:14077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031a00/0x8c5345f1c1ec6147 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240113.748946:0:14077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5c0031a00 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:0.0:1782240113.748951:0:14077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031a00/0x8c5345f1c1ec6147 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240113.748959:0:14077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031a00/0x8c5345f1c1ec6147 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240113.748977:0:14077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bb5cfd09400) 00010000:00010000:0.0:1782240113.748980:0:14077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782240113.748985:0:14077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031a00/0x8c5345f1c1ec6147 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240113.748991:0:14077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031a00/0x8c5345f1c1ec6147 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782240113.749024:0:14077:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c88e92a7 reply state 000000004fe276ee transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030000/0x8c5345f1c1ec614e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782240113.749034:0:14077:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782240113.749411:0:14077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f46fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+10:14371:x1868813738034560:12345-192.168.203.32@tcp:36:lfs.0 Request processed in 11456us (11781us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1782240113.749421:0:14077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 19 00010000:00010000:0.0:1782240113.753065:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030000/0x8c5345f1c1ec614e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240113.753081:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030000/0x8c5345f1c1ec614e lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240113.753087:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030000/0x8c5345f1c1ec614e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240113.753093:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5c0030000 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:0.0:1782240113.753098:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030000/0x8c5345f1c1ec614e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240113.753105:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030000/0x8c5345f1c1ec614e lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240113.753122:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9bb5cfd09e00) 00010000:00010000:0.0:1782240113.753125:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782240113.753130:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030000/0x8c5345f1c1ec614e lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240113.753136:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030000/0x8c5345f1c1ec614e lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782240113.894848:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782240113.894975:0:14076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738034816 00000100:00100000:0.0:1782240113.894985:0:14076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738034816 00000100:00100000:0.0:1782240113.895055:0:14076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 20 00000100:00100000:0.0:1782240113.895066:0:14076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb6018cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+9:14379:x1868813738034816:12345-192.168.203.32@tcp:101:lctl.0 00010000:00010000:0.0:1782240113.895090:0:14076:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782240113.895361:0:14076:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030000/0x8c5345f1c1ec6155 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e954 expref: -99 pid: 14076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240113.895428:0:14076:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031a00/0x8c5345f1c1ec615c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240113.895443:0:14076:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031a00/0x8c5345f1c1ec615c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240113.895453:0:14076:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031a00/0x8c5345f1c1ec615c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14076 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782240113.895514:0:14076:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1782240113.895518:0:14076:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:0.0:1782240113.896232:0:14076:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031a00/0x8c5345f1c1ec615c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240113.896264:0:14076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030000/0x8c5345f1c1ec6155 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e954 expref: 11 pid: 14076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240113.896283:0:14076:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031a00/0x8c5345f1c1ec615c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e954 expref: 10 pid: 14076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240113.896292:0:14076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bb5cfd09e00) 00010000:00010000:0.0:1782240113.896307:0:14076:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782240113.896311:0:14076:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5c0031a00, rc 0) 00000100:00100000:0.0:1782240113.896378:0:14076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb6018cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+10:14379:x1868813738034816:12345-192.168.203.32@tcp:101:lctl.0 Request processed in 1314us (1540us total) trans 0 rc 0/0 00000100:00100000:0.0:1782240113.896386:0:14076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 20 00000100:00100000:3.0:1782240113.936112:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782240113.936203:0:15850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738034944 00000100:00100000:2.0:1782240113.936215:0:15850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738034944 00000100:00100000:2.0:1782240113.936276:0:15850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 21 00000100:00100000:2.0:1782240113.936311:0:15850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f46ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e915549f-7383-4873-bb08-ab4dbf0961dd+5:14380:x1868813738034944:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:2.0:1782240113.936333:0:15850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782240113.936352:0:15850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2018000/0x8c5345f1c1ec6163 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e95b expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240113.936425:0:15850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019400/0x8c5345f1c1ec616a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240113.936439:0:15850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019400/0x8c5345f1c1ec616a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240113.936453:0:15850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019400/0x8c5345f1c1ec616a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782240113.936514:0:15850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1782240113.936518:0:15850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:2.0:1782240113.936546:0:15850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019400/0x8c5345f1c1ec616a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240113.936571:0:15850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2018000/0x8c5345f1c1ec6163 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e95b expref: 7 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240113.936597:0:15850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019400/0x8c5345f1c1ec616a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e95b expref: 6 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240113.936618:0:15850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bb5cfd09e00) 00010000:00010000:2.0:1782240113.936622:0:15850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782240113.936626:0:15850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb4c2019400, rc 0) 00000100:00100000:2.0:1782240113.937250:0:15850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f46ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e915549f-7383-4873-bb08-ab4dbf0961dd+6:14380:x1868813738034944:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 937us (1153us total) trans 0 rc 0/0 00000100:00100000:2.0:1782240113.937270:0:15850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 21 00000100:00100000:1.0:1782240113.940482:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782240113.943307:0:14078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738035072 00000100:00100000:2.0:1782240113.943322:0:14078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738035072 00000100:00100000:2.0:1782240113.943393:0:14078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 22 00000100:00100000:2.0:1782240113.943404:0:14078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e915549f-7383-4873-bb08-ab4dbf0961dd+6:14380:x1868813738035072:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:2.0:1782240113.943427:0:14078:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782240113.943449:0:14078:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019600/0x8c5345f1c1ec6171 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e962 expref: -99 pid: 14078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240113.943518:0:14078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2018c00/0x8c5345f1c1ec6178 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240113.943532:0:14078:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2018c00/0x8c5345f1c1ec6178 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240113.943543:0:14078:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2018c00/0x8c5345f1c1ec6178 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240113.943558:0:14078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019c00/0x8c5345f1c1ec617f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240113.943578:0:14078:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019c00/0x8c5345f1c1ec617f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240113.943585:0:14078:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019c00/0x8c5345f1c1ec617f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240113.945116:0:14078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019200/0x8c5345f1c1ec6186 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240113.945156:0:14078:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019200/0x8c5345f1c1ec6186 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240113.945167:0:14078:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019200/0x8c5345f1c1ec6186 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782240113.945233:0:14078:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1782240113.945237:0:14078:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782240113.945263:0:14078:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019200/0x8c5345f1c1ec6186 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240113.945278:0:14078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2018c00/0x8c5345f1c1ec6178 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240113.945286:0:14078:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2018c00/0x8c5345f1c1ec6178 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240113.945293:0:14078:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2018c00/0x8c5345f1c1ec6178 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240113.945299:0:14078:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb4c2018c00 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:2.0:1782240113.945303:0:14078:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2018c00/0x8c5345f1c1ec6178 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240113.945310:0:14078:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2018c00/0x8c5345f1c1ec6178 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240113.945323:0:14078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bb5cfd09e00) 00010000:00010000:2.0:1782240113.945326:0:14078:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782240113.945330:0:14078:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2018c00/0x8c5345f1c1ec6178 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240113.945346:0:14078:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2018c00/0x8c5345f1c1ec6178 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240113.945363:0:14078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019c00/0x8c5345f1c1ec617f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240113.945370:0:14078:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019c00/0x8c5345f1c1ec617f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240113.945376:0:14078:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019c00/0x8c5345f1c1ec617f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240113.945381:0:14078:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb4c2019c00 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:2.0:1782240113.945385:0:14078:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019c00/0x8c5345f1c1ec617f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240113.945392:0:14078:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019c00/0x8c5345f1c1ec617f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240113.945399:0:14078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9bb5c2e3a200) 00010000:00010000:2.0:1782240113.945402:0:14078:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782240113.945405:0:14078:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019c00/0x8c5345f1c1ec617f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240113.945412:0:14078:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019c00/0x8c5345f1c1ec617f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240113.945453:0:14078:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019600/0x8c5345f1c1ec6171 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e962 expref: 8 pid: 14078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240113.945481:0:14078:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019200/0x8c5345f1c1ec6186 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e962 expref: 7 pid: 14078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240113.945489:0:14078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bb5c2e3ac00) 00010000:00010000:2.0:1782240113.945492:0:14078:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782240113.945494:0:14078:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb4c2019200, rc 0) 00000100:00100000:2.0:1782240113.945574:0:14078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e915549f-7383-4873-bb08-ab4dbf0961dd+7:14380:x1868813738035072:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 2171us (5099us total) trans 0 rc 0/0 00000100:00100000:2.0:1782240113.945583:0:14078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 22 00000100:00100000:2.0:1782240113.955954:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782240113.956038:0:14077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738035328 00000100:00100000:0.0:1782240113.956048:0:14077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738035328 00000100:00100000:0.0:1782240113.956101:0:14077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 23 00000100:00100000:0.0:1782240113.956112:0:14077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb6018cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e915549f-7383-4873-bb08-ab4dbf0961dd+7:14380:x1868813738035328:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:0.0:1782240113.956131:0:14077:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782240113.956149:0:14077:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030000/0x8c5345f1c1ec618d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e969 expref: -99 pid: 14077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782240113.956256:0:14077:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1782240113.956371:0:14077:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030000/0x8c5345f1c1ec618d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e969 expref: 9 pid: 14077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240113.956385:0:14077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bb5cfd09e00) 00010000:00010000:0.0:1782240113.956388:0:14077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782240113.956393:0:14077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030000/0x8c5345f1c1ec618d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e969 expref: 9 pid: 14077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240113.956407:0:14077:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5c0030000, rc 0) 00000100:00100000:0.0:1782240113.956465:0:14077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb6018cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e915549f-7383-4873-bb08-ab4dbf0961dd+8:14380:x1868813738035328:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 355us (520us total) trans 8589934595 rc 301/301 00000100:00100000:0.0:1782240113.956473:0:14077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 23 00000100:00100000:1.0:1782240113.961094:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782240113.961254:0:14078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738035584 00000100:00100000:2.0:1782240113.961263:0:14078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738035584 00000100:00100000:2.0:1782240113.961330:0:14078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 24 00000100:00100000:2.0:1782240113.961347:0:14078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e915549f-7383-4873-bb08-ab4dbf0961dd+8:14380:x1868813738035584:12345-192.168.203.32@tcp:36:lfs.0 00010000:00010000:2.0:1782240113.961402:0:14078:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782240113.961429:0:14078:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019200/0x8c5345f1c1ec6186 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e962 expref: 8 pid: 14078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240113.961448:0:14078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bb5c2e3ac00) 00010000:00010000:2.0:1782240113.961457:0:14078:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782240113.961480:0:14078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019600/0x8c5345f1c1ec619b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240113.961492:0:14078:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019600/0x8c5345f1c1ec619b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240113.961502:0:14078:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019600/0x8c5345f1c1ec619b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782240113.962333:0:14078:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000050b76672 reply state 00000000356898f4 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019600/0x8c5345f1c1ec619b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782240113.962355:0:14078:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1782240113.962374:0:14078:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:2.0:1782240113.962460:0:14078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e915549f-7383-4873-bb08-ab4dbf0961dd+9:14380:x1868813738035584:12345-192.168.203.32@tcp:36:lfs.0 Request processed in 1119us (1373us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1782240113.962468:0:14078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 24 00010000:00010000:0.0:1782240113.966306:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019600/0x8c5345f1c1ec619b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240113.966335:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019600/0x8c5345f1c1ec619b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240113.966343:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019600/0x8c5345f1c1ec619b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240113.966350:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb4c2019600 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:0.0:1782240113.966354:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019600/0x8c5345f1c1ec619b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240113.966362:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019600/0x8c5345f1c1ec619b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240113.966379:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bb5c2e3a200) 00010000:00010000:0.0:1782240113.966382:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1782240113.966388:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019600/0x8c5345f1c1ec619b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240113.966394:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019600/0x8c5345f1c1ec619b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782240113.966406:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782240113.966540:0:14080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738035840 00000100:00100000:3.0:1782240113.966550:0:14080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738035840 00000100:00100000:3.0:1782240113.966601:0:14080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 2 00000100:00100000:3.0:1782240113.966620:0:14080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e915549f-7383-4873-bb08-ab4dbf0961dd+8:14380:x1868813738035840:12345-192.168.203.32@tcp:35:lfs.0 00000100:00100000:3.0:1782240113.966903:0:14080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e915549f-7383-4873-bb08-ab4dbf0961dd+9:14380:x1868813738035840:12345-192.168.203.32@tcp:35:lfs.0 Request processed in 284us (504us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1782240113.966912:0:14080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 2 00000100:00100000:3.0:1782240113.973208:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782240113.973313:0:14077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738036096 00000100:00100000:0.0:1782240113.973323:0:14077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738036096 00000100:00100000:0.0:1782240113.973387:0:14077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 25 00000100:00100000:0.0:1782240113.973397:0:14077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f46fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e915549f-7383-4873-bb08-ab4dbf0961dd+9:14380:x1868813738036096:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:0.0:1782240113.973424:0:14077:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782240113.973452:0:14077:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030000/0x8c5345f1c1ec61a2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e970 expref: -99 pid: 14077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240113.973526:0:14077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031000/0x8c5345f1c1ec61a9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240113.973560:0:14077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031000/0x8c5345f1c1ec61a9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240113.973573:0:14077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031000/0x8c5345f1c1ec61a9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240113.973589:0:14077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031200/0x8c5345f1c1ec61b0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240113.973597:0:14077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031200/0x8c5345f1c1ec61b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240113.973604:0:14077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031200/0x8c5345f1c1ec61b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782240113.973731:0:14077:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1782240113.974167:0:14077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031000/0x8c5345f1c1ec61a9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240113.974176:0:14077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031000/0x8c5345f1c1ec61a9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240113.974183:0:14077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031000/0x8c5345f1c1ec61a9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240113.974188:0:14077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5c0031000 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:0.0:1782240113.974193:0:14077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031000/0x8c5345f1c1ec61a9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240113.974201:0:14077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031000/0x8c5345f1c1ec61a9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240113.974227:0:14077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bb5cfd09e00) 00010000:00010000:0.0:1782240113.974230:0:14077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782240113.974235:0:14077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031000/0x8c5345f1c1ec61a9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240113.974241:0:14077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031000/0x8c5345f1c1ec61a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240113.974254:0:14077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031200/0x8c5345f1c1ec61b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240113.974261:0:14077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031200/0x8c5345f1c1ec61b0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240113.974266:0:14077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031200/0x8c5345f1c1ec61b0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240113.974271:0:14077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5c0031200 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:0.0:1782240113.974275:0:14077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031200/0x8c5345f1c1ec61b0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240113.974280:0:14077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031200/0x8c5345f1c1ec61b0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240113.974287:0:14077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9bb5cfd09400) 00010000:00010000:0.0:1782240113.974290:0:14077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782240113.974293:0:14077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031200/0x8c5345f1c1ec61b0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240113.974299:0:14077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031200/0x8c5345f1c1ec61b0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240113.974354:0:14077:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030000/0x8c5345f1c1ec61a2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e970 expref: 11 pid: 14077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240113.974365:0:14077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bb5cfd09e00) 00010000:00010000:0.0:1782240113.974367:0:14077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782240113.974371:0:14077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030000/0x8c5345f1c1ec61a2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e970 expref: 11 pid: 14077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240113.974380:0:14077:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5c0030000, rc 0) 00000100:00100000:0.0:1782240113.974662:0:14077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f46fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e915549f-7383-4873-bb08-ab4dbf0961dd+10:14380:x1868813738036096:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 1264us (1470us total) trans 8589934598 rc 301/301 00000100:00100000:0.0:1782240113.974671:0:14077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 25 00000100:00100000:1.0:1782240113.981664:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782240113.981787:0:14076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738036224 00000100:00100000:0.0:1782240113.981797:0:14076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738036224 00000100:00100000:0.0:1782240113.981854:0:14076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 26 00000100:00100000:0.0:1782240113.981865:0:14076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e915549f-7383-4873-bb08-ab4dbf0961dd+10:14380:x1868813738036224:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:0.0:1782240113.981890:0:14076:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782240113.981913:0:14076:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030800/0x8c5345f1c1ec61be lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e977 expref: -99 pid: 14076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240113.982010:0:14076:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031800/0x8c5345f1c1ec61c5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240113.982023:0:14076:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031800/0x8c5345f1c1ec61c5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240113.982035:0:14076:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031800/0x8c5345f1c1ec61c5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14076 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782240113.982100:0:14076:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1782240113.982103:0:14076:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782240113.982123:0:14076:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031800/0x8c5345f1c1ec61c5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240113.982149:0:14076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030800/0x8c5345f1c1ec61be lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e977 expref: 12 pid: 14076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240113.982167:0:14076:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031800/0x8c5345f1c1ec61c5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e977 expref: 11 pid: 14076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240113.982175:0:14076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bb5cfd09600) 00010000:00010000:0.0:1782240113.982178:0:14076:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782240113.982181:0:14076:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5c0031800, rc 0) 00000100:00100000:0.0:1782240113.982238:0:14076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e915549f-7383-4873-bb08-ab4dbf0961dd+11:14380:x1868813738036224:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 375us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1782240113.982245:0:14076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 26 00000100:00100000:1.0:1782240113.987478:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782240113.987560:0:14080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738036352 00000100:00100000:3.0:1782240113.987569:0:14080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738036352 00000100:00100000:3.0:1782240113.987621:0:14080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 3 00000100:00100000:3.0:1782240113.987629:0:14080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e915549f-7383-4873-bb08-ab4dbf0961dd+11:14380:x1868813738036352:12345-192.168.203.32@tcp:37:lfs.0 00000100:00100000:1.0:1782240113.990936:0:14080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e915549f-7383-4873-bb08-ab4dbf0961dd+11:14380:x1868813738036352:12345-192.168.203.32@tcp:37:lfs.0 Request processed in 3289us (3449us total) trans 0 rc 0/0 00000100:00100000:1.0:1782240113.990954:0:14080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 3 00000100:00100000:1.0:1782240113.998091:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782240113.998177:0:14079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738036608 00000100:00100000:2.0:1782240113.998187:0:14079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738036608 00000100:00100000:2.0:1782240113.998242:0:14079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 4 00000100:00100000:2.0:1782240113.998251:0:14079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f4422450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e915549f-7383-4873-bb08-ab4dbf0961dd+11:14380:x1868813738036608:12345-192.168.203.32@tcp:35:lfs.0 00000100:00100000:2.0:1782240113.998501:0:14079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f4422450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e915549f-7383-4873-bb08-ab4dbf0961dd+12:14380:x1868813738036608:12345-192.168.203.32@tcp:35:lfs.0 Request processed in 250us (417us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1782240113.998509:0:14079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 4 00000100:00100000:0.0:1782240114.079432:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782240114.079594:0:15850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738036736 00000100:00100000:2.0:1782240114.079605:0:15850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738036736 00000100:00100000:2.0:1782240114.079794:0:15850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 27 00000100:00100000:2.0:1782240114.079806:0:15850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5eddf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+10:14386:x1868813738036736:12345-192.168.203.32@tcp:101:bash.0 00010000:00010000:2.0:1782240114.079825:0:15850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782240114.079844:0:15850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019200/0x8c5345f1c1ec61cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e97e expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240114.079907:0:15850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019c00/0x8c5345f1c1ec61d3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240114.079933:0:15850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019c00/0x8c5345f1c1ec61d3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240114.079958:0:15850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019c00/0x8c5345f1c1ec61d3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240114.079974:0:15850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2018c00/0x8c5345f1c1ec61da lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240114.079981:0:15850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2018c00/0x8c5345f1c1ec61da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240114.079987:0:15850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2018c00/0x8c5345f1c1ec61da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240114.080094:0:15850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2018000/0x8c5345f1c1ec61e1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240114.080102:0:15850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2018000/0x8c5345f1c1ec61e1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240114.080109:0:15850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2018000/0x8c5345f1c1ec61e1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782240114.080139:0:15850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1782240114.080142:0:15850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782240114.080176:0:15850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2018000/0x8c5345f1c1ec61e1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240114.080187:0:15850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019c00/0x8c5345f1c1ec61d3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240114.080206:0:15850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019c00/0x8c5345f1c1ec61d3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240114.080221:0:15850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019c00/0x8c5345f1c1ec61d3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240114.080228:0:15850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb4c2019c00 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:2.0:1782240114.080232:0:15850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019c00/0x8c5345f1c1ec61d3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240114.080240:0:15850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019c00/0x8c5345f1c1ec61d3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240114.080252:0:15850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bb5cfd09e00) 00010000:00010000:2.0:1782240114.080255:0:15850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782240114.081433:0:15850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019c00/0x8c5345f1c1ec61d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240114.081449:0:15850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019c00/0x8c5345f1c1ec61d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240114.081468:0:15850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2018c00/0x8c5345f1c1ec61da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240114.081475:0:15850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2018c00/0x8c5345f1c1ec61da lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240114.081482:0:15850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2018c00/0x8c5345f1c1ec61da lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240114.081486:0:15850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb4c2018c00 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:2.0:1782240114.081490:0:15850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2018c00/0x8c5345f1c1ec61da lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240114.081511:0:15850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2018c00/0x8c5345f1c1ec61da lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240114.081523:0:15850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9bb5c2e3ac00) 00010000:00010000:2.0:1782240114.081526:0:15850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782240114.081529:0:15850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2018c00/0x8c5345f1c1ec61da lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240114.081535:0:15850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2018c00/0x8c5345f1c1ec61da lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240114.081579:0:15850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019200/0x8c5345f1c1ec61cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e97e expref: 12 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240114.081592:0:15850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2018000/0x8c5345f1c1ec61e1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e97e expref: 11 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240114.081598:0:15850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bb5cfd09600) 00010000:00010000:2.0:1782240114.081601:0:15850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1782240114.081603:0:15850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb4c2018000, rc 0) 00000100:00100000:2.0:1782240114.081668:0:15850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5eddf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+11:14386:x1868813738036736:12345-192.168.203.32@tcp:101:bash.0 Request processed in 1864us (2245us total) trans 0 rc 0/0 00000100:00100000:2.0:1782240114.081676:0:15850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 27 00000100:00100000:3.0:1782240114.085968:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782240114.087418:0:14077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738036992 00000100:00100000:0.0:1782240114.087432:0:14077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738036992 00000100:00100000:0.0:1782240114.087502:0:14077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 28 00000100:00100000:0.0:1782240114.087512:0:14077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f46fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+11:14386:x1868813738036992:12345-192.168.203.32@tcp:101:bash.0 00010000:00010000:0.0:1782240114.087534:0:14077:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782240114.087553:0:14077:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030000/0x8c5345f1c1ec61e8 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e985 expref: -99 pid: 14077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240114.087693:0:14077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031200/0x8c5345f1c1ec61ef lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240114.087721:0:14077:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031800/0x8c5345f1c1ec61c5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e977 expref: 11 pid: 14076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240114.087731:0:14077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031200/0x8c5345f1c1ec61ef lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240114.087784:0:14077:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031800/0x8c5345f1c1ec61c5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e977 expref: 11 pid: 14076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240114.087799:0:14077:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031800/0x8c5345f1c1ec61c5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e977 expref: 11 pid: 14076 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782240114.087814:0:14077:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5eddf6300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14077:1868813759000320:192.168.203.32@tcp:104: 00000100:00100000:0.0:1782240114.088158:0:14077:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c2c79240 going to sleep for 11 seconds 00000100:00100000:1.0:1782240114.095592:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782240114.095991:0:14077:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5eddf6300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14077:1868813759000320:192.168.203.32@tcp:104: 00010000:00010000:0.0:1782240114.096028:0:14077:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031200/0x8c5345f1c1ec61ef lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782240114.096408:0:14062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738037120 00000100:00100000:3.0:1782240114.096416:0:14062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738037120 00010000:00010000:3.0:1782240114.096456:0:14062:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031800/0x8c5345f1c1ec61c5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e977 expref: 12 pid: 14076 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782240114.096529:0:14062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 10 00000100:00100000:3.0:1782240114.096540:0:14062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e915549f-7383-4873-bb08-ab4dbf0961dd+12:2344:x1868813738037120:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782240114.096557:0:14062:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782240114.096564:0:14062:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031800/0x8c5345f1c1ec61c5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e977 expref: 12 pid: 14076 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240114.096577:0:14062:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031800/0x8c5345f1c1ec61c5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e977 expref: 12 pid: 14076 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240114.096599:0:14062:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031800/0x8c5345f1c1ec61c5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e977 expref: 12 pid: 14076 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240114.096614:0:14062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bb5cfd09600) 00010000:00010000:3.0:1782240114.096618:0:14062:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031200/0x8c5345f1c1ec61ef lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240114.096627:0:14062:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031200/0x8c5345f1c1ec61ef lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240114.096635:0:14062:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031200/0x8c5345f1c1ec61ef lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240114.096690:0:14062:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782240114.096768:0:14062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e915549f-7383-4873-bb08-ab4dbf0961dd+11:2344:x1868813738037120:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 228us (1185us total) trans 0 rc 0/0 00000100:00100000:3.0:1782240114.096776:0:14062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 10 00010000:00010000:0.0:1782240114.096832:0:14077:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031200/0x8c5345f1c1ec61ef lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240114.096841:0:14077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031200/0x8c5345f1c1ec61ef lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240114.096864:0:14077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031000/0x8c5345f1c1ec61f6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240114.096875:0:14077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031000/0x8c5345f1c1ec61f6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240114.096889:0:14077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031000/0x8c5345f1c1ec61f6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240114.097529:0:14077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030800/0x8c5345f1c1ec61fd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240114.097541:0:14077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030800/0x8c5345f1c1ec61fd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240114.097549:0:14077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030800/0x8c5345f1c1ec61fd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782240114.097560:0:14077:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1782240114.097587:0:14077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031200/0x8c5345f1c1ec61ef lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240114.097594:0:14077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031200/0x8c5345f1c1ec61ef lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240114.097600:0:14077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031200/0x8c5345f1c1ec61ef lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240114.097606:0:14077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5c0031200 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:0.0:1782240114.097611:0:14077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031200/0x8c5345f1c1ec61ef lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240114.097617:0:14077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031200/0x8c5345f1c1ec61ef lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240114.097626:0:14077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bb5cfd09600) 00010000:00010000:0.0:1782240114.097629:0:14077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782240114.097641:0:14077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031200/0x8c5345f1c1ec61ef lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240114.097647:0:14077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031200/0x8c5345f1c1ec61ef lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782240114.097658:0:14077:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008117d642 reply state 000000000c4a1429 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031000/0x8c5345f1c1ec61f6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782240114.097665:0:14077:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1782240114.097696:0:14077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030000/0x8c5345f1c1ec61e8 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e985 expref: 14 pid: 14077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240114.097711:0:14077:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030800/0x8c5345f1c1ec61fd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e985 expref: 13 pid: 14077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240114.097718:0:14077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bb5cfd09a00) 00010000:00010000:0.0:1782240114.097720:0:14077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1782240114.097722:0:14077:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5c0030800, rc 0) 00000100:00100000:0.0:1782240114.097790:0:14077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f46fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+14:14386:x1868813738036992:12345-192.168.203.32@tcp:101:bash.0 Request processed in 10279us (11831us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1782240114.097797:0:14077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 28 00010000:00010000:3.0:1782240114.101531:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031000/0x8c5345f1c1ec61f6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240114.101548:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031000/0x8c5345f1c1ec61f6 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240114.101555:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031000/0x8c5345f1c1ec61f6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240114.101561:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5c0031000 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:3.0:1782240114.101566:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031000/0x8c5345f1c1ec61f6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240114.101574:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031000/0x8c5345f1c1ec61f6 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240114.101591:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9bb5cfd09400) 00010000:00010000:3.0:1782240114.101594:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782240114.101599:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031000/0x8c5345f1c1ec61f6 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240114.101605:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031000/0x8c5345f1c1ec61f6 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782240114.129156:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782240114.129262:0:15850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738037248 00000100:00100000:2.0:1782240114.129273:0:15850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738037248 00000100:00100000:2.0:1782240114.129331:0:15850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 29 00000100:00100000:2.0:1782240114.129342:0:15850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+13:14386:x1868813738037248:12345-192.168.203.32@tcp:101:bash.0 00010000:00010000:2.0:1782240114.129399:0:15850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782240114.129422:0:15850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019200/0x8c5345f1c1ec620b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e98c expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240114.129487:0:15850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2018c00/0x8c5345f1c1ec6212 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240114.129502:0:15850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2018c00/0x8c5345f1c1ec6212 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240114.129514:0:15850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2018c00/0x8c5345f1c1ec6212 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782240114.129564:0:15850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1782240114.129569:0:15850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782240114.129589:0:15850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2018c00/0x8c5345f1c1ec6212 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240114.129599:0:15850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2018c00/0x8c5345f1c1ec6212 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240114.129623:0:15850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019200/0x8c5345f1c1ec620b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e98c expref: 15 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240114.129640:0:15850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2018c00/0x8c5345f1c1ec6212 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e98c expref: 14 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240114.129649:0:15850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bb5cfd09a00) 00010000:00010000:2.0:1782240114.129652:0:15850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782240114.129655:0:15850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb4c2018c00, rc 0) 00000100:00100000:2.0:1782240114.129726:0:15850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+14:14386:x1868813738037248:12345-192.168.203.32@tcp:101:bash.0 Request processed in 385us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1782240114.129741:0:15850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 29 00000100:00100000:0.0:1782240114.137098:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782240114.137190:0:14079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738037504 00000100:00100000:2.0:1782240114.137201:0:14079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738037504 00000100:00100000:2.0:1782240114.137274:0:14079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 5 00000100:00100000:2.0:1782240114.137285:0:14079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5eddf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+14:14386:x1868813738037504:12345-192.168.203.32@tcp:35:bash.0 00000100:00100000:2.0:1782240114.138161:0:14079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5eddf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+15:14386:x1868813738037504:12345-192.168.203.32@tcp:35:bash.0 Request processed in 873us (1066us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1782240114.138170:0:14079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 5 00010000:00010000:0.0:1782240114.143125:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782240114.198424:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782240114.198471:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782240114.198498:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782240114.198537:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782240114.198563:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782240114.198581:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782240114.198617:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782240114.198638:0:14714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738038016 00000100:00100000:1.0:1782240114.198638:0:14071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738037632 00000100:00100000:3.0:1782240114.198647:0:14714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738038016 00000100:00100000:1.0:1782240114.198647:0:14071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738037632 00000100:00100000:3.0:1782240114.198688:0:14714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738038272 00000100:00100000:3.0:1782240114.198691:0:14714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738038272 00000100:00100000:1.0:1782240114.198699:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 122 00000100:00100000:3.0:1782240114.198702:0:14714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738037888 00000100:00100000:3.0:1782240114.198704:0:14714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738037888 00000100:00100000:1.0:1782240114.198708:0:14071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ee8efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94a0379e-2f28-4d53-90a1-f8718289b741+13:2346:x1868813738037632:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:3.0:1782240114.198713:0:14714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738038400 00000100:00100000:3.0:1782240114.198715:0:14714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738038400 00000100:00100000:3.0:1782240114.198726:0:14714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 11 00000100:00100000:3.0:1782240114.198731:0:14714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+5:2346:x1868813738038016:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:3.0:1782240114.198805:0:14714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+5:2346:x1868813738038016:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 72us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1782240114.198813:0:14714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 11 00000100:00100000:3.0:1782240114.198828:0:14714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 12 00000100:00100000:3.0:1782240114.198833:0:14714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e915549f-7383-4873-bb08-ab4dbf0961dd+5:2346:x1868813738038272:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:0.0:1782240114.198877:0:14076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738037760 00000100:00100000:0.0:1782240114.198882:0:14076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738037760 00000100:00100000:0.0:1782240114.198910:0:14076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738038144 00000100:00100000:0.0:1782240114.198913:0:14076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738038144 00000100:00100000:0.0:1782240114.198943:0:14076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 24 00000100:00100000:0.0:1782240114.198950:0:14076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+15:2346:x1868813738037760:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:2.0:1782240114.201870:0:14713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 13 00000100:00100000:2.0:1782240114.201898:0:14713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+5:2346:x1868813738037888:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:1.0:1782240114.202106:0:14071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ee8efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94a0379e-2f28-4d53-90a1-f8718289b741+13:2346:x1868813738037632:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 3397us (3565us total) trans 0 rc 0/0 00000100:00100000:1.0:1782240114.202133:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 122 00000100:00100000:1.0:1782240114.202215:0:14077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 25 00000100:00100000:1.0:1782240114.202225:0:14077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f48c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e915549f-7383-4873-bb08-ab4dbf0961dd+11:2346:x1868813738038144:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:1.0:1782240114.202273:0:14077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e915549f-7383-4873-bb08-ab4dbf0961dd+11:2346:x1868813738038144:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 50us (3690us total) trans 0 rc 0/0 00000100:00100000:1.0:1782240114.202280:0:14077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 25 00000100:00080000:1.0:1782240114.202450:0:14072:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782240114.202456:0:14072:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782240114.202532:0:14714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e915549f-7383-4873-bb08-ab4dbf0961dd+5:2346:x1868813738038272:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 3696us (4030us total) trans 0 rc 0/0 00000100:00100000:3.0:1782240114.202601:0:14714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 12 00000100:00100000:3.0:1782240114.202619:0:14714:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1782240114.202627:0:14714:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1782240114.203020:0:14076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+15:2346:x1868813738037760:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 4066us (4602us total) trans 0 rc 0/0 00000100:00100000:0.0:1782240114.203029:0:14076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 24 00000100:00100000:2.0:1782240114.203119:0:14713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f48c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+5:2346:x1868813738037888:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 1234us (4553us total) trans 0 rc 0/0 00000100:00100000:2.0:1782240114.203126:0:14713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 13 00000100:00100000:2.0:1782240114.203144:0:14713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 14 00000100:00100000:2.0:1782240114.203155:0:14713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f77a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e915549f-7383-4873-bb08-ab4dbf0961dd+5:2346:x1868813738038400:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:2.0:1782240114.203189:0:14713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f77a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e915549f-7383-4873-bb08-ab4dbf0961dd+5:2346:x1868813738038400:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 37us (4571us total) trans 0 rc 0/0 00000100:00100000:2.0:1782240114.203195:0:14713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 14 00000100:00100000:1.0:1782240114.287780:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782240114.287948:0:14077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738038656 00000100:00100000:0.0:1782240114.287958:0:14077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738038656 00000100:00100000:0.0:1782240114.288017:0:14077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 30 00000100:00100000:0.0:1782240114.288026:0:14077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f77a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+15:14396:x1868813738038656:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:0.0:1782240114.288046:0:14077:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782240114.288065:0:14077:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030000/0x8c5345f1c1ec6219 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e993 expref: -99 pid: 14077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782240114.288176:0:14077:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1782240114.288313:0:14077:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030000/0x8c5345f1c1ec6219 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e993 expref: 17 pid: 14077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240114.288328:0:14077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bb5cfd09e00) 00010000:00010000:0.0:1782240114.288331:0:14077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782240114.288335:0:14077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030000/0x8c5345f1c1ec6219 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e993 expref: 17 pid: 14077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240114.288350:0:14077:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5c0030000, rc 0) 00000100:00100000:0.0:1782240114.288457:0:14077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f77a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+16:14396:x1868813738038656:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 432us (712us total) trans 8589934602 rc 301/301 00000100:00100000:0.0:1782240114.288465:0:14077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 30 00000100:00100000:1.0:1782240114.294795:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782240114.294875:0:14080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738038912 00000100:00100000:3.0:1782240114.294886:0:14080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738038912 00000100:00100000:3.0:1782240114.294953:0:14080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 6 00000100:00100000:3.0:1782240114.294964:0:14080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f77a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+16:14396:x1868813738038912:12345-192.168.203.32@tcp:35:lfs.0 00000100:00100000:3.0:1782240114.295227:0:14080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f77a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+17:14396:x1868813738038912:12345-192.168.203.32@tcp:35:lfs.0 Request processed in 265us (439us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1782240114.295236:0:14080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 6 00000100:00100000:1.0:1782240114.338016:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782240114.338667:0:15850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738039168 00000100:00100000:2.0:1782240114.338678:0:15850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738039168 00000100:00100000:2.0:1782240114.338831:0:15850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 31 00000100:00100000:2.0:1782240114.338843:0:15850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f77f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+17:14399:x1868813738039168:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:2.0:1782240114.338882:0:15850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782240114.338903:0:15850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019200/0x8c5345f1c1ec6227 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e99a expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240114.339013:0:15850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019c00/0x8c5345f1c1ec622e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240114.339028:0:15850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019c00/0x8c5345f1c1ec622e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240114.339040:0:15850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019c00/0x8c5345f1c1ec622e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782240114.339051:0:15850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1782240114.339180:0:15850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019200/0x8c5345f1c1ec6227 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e99a expref: 20 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240114.339467:0:15850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019c00/0x8c5345f1c1ec622e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e99a expref: 19 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240114.339478:0:15850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bb5cfd09a00) 00010000:00010000:2.0:1782240114.339481:0:15850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782240114.339485:0:15850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb4c2019c00, rc 0) 00000100:00100000:2.0:1782240114.339601:0:15850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f77f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+19:14399:x1868813738039168:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 760us (1595us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1782240114.339608:0:15850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 31 00000100:00100000:1.0:1782240114.347380:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782240114.349781:0:14061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738039296 00000100:00100000:3.0:1782240114.349797:0:14061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738039296 00000100:00100000:3.0:1782240114.349881:0:14061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 0 00000100:00100000:3.0:1782240114.349890:0:14061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f77f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+19:2344:x1868813738039296:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782240114.349906:0:14061:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782240114.349940:0:14061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019c00/0x8c5345f1c1ec622e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e99a expref: 19 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240114.349959:0:14061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bb5cfd09a00) 00010000:00010000:3.0:1782240114.349964:0:14061:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782240114.350022:0:14061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f77f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+18:2344:x1868813738039296:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 133us (2650us total) trans 0 rc 0/0 00000100:00100000:3.0:1782240114.350030:0:14061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 0 00000100:00100000:0.0:1782240114.350183:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782240114.350373:0:14077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738039424 00000100:00100000:2.0:1782240114.350378:0:14077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738039424 00000100:00100000:2.0:1782240114.350420:0:14077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 32 00000100:00100000:2.0:1782240114.350439:0:14077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5eddf5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+18:14399:x1868813738039424:12345-192.168.203.32@tcp:54:lfs.0 00010000:00010000:2.0:1782240114.350497:0:14077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019200/0x8c5345f1c1ec623c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240114.350511:0:14077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019200/0x8c5345f1c1ec623c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240114.350522:0:14077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019200/0x8c5345f1c1ec623c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240114.350547:0:14077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019200/0x8c5345f1c1ec623c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240114.350555:0:14077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019200/0x8c5345f1c1ec623c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240114.350560:0:14077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019200/0x8c5345f1c1ec623c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240114.350566:0:14077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb4c2019200 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:2.0:1782240114.350570:0:14077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019200/0x8c5345f1c1ec623c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240114.350576:0:14077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019200/0x8c5345f1c1ec623c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240114.350585:0:14077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bb5cfd09a00) 00010000:00010000:2.0:1782240114.350588:0:14077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782240114.350592:0:14077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019200/0x8c5345f1c1ec623c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240114.350598:0:14077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019200/0x8c5345f1c1ec623c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782240114.350657:0:14077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5eddf5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+18:14399:x1868813738039424:12345-192.168.203.32@tcp:54:lfs.0 Request processed in 220us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1782240114.350664:0:14077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 32 00000100:00100000:0.0:1782240114.361299:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782240114.361397:0:14080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738039680 00000100:00100000:3.0:1782240114.361409:0:14080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738039680 00000100:00100000:3.0:1782240114.361468:0:14080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 7 00000100:00100000:3.0:1782240114.361478:0:14080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5eddf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+18:14399:x1868813738039680:12345-192.168.203.32@tcp:35:lfs.0 00000100:00100000:3.0:1782240114.361725:0:14080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5eddf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+19:14399:x1868813738039680:12345-192.168.203.32@tcp:35:lfs.0 Request processed in 247us (433us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1782240114.361733:0:14080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 7 00000100:00100000:1.0:1782240114.718372:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782240114.718535:0:14076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738039936 00000100:00100000:0.0:1782240114.718556:0:14076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738039936 00000100:00100000:0.0:1782240114.718622:0:14076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 33 00000100:00100000:0.0:1782240114.718633:0:14076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f77f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+19:14430:x1868813738039936:12345-192.168.203.32@tcp:101:cat.0 00010000:00010000:0.0:1782240114.718659:0:14076:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782240114.718675:0:14076:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031400/0x8c5345f1c1ec6243 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e9a1 expref: -99 pid: 14076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240114.718808:0:14076:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030e00/0x8c5345f1c1ec624a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240114.718822:0:14076:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030e00/0x8c5345f1c1ec624a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240114.718832:0:14076:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030e00/0x8c5345f1c1ec624a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14076 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782240114.718844:0:14076:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1782240114.719006:0:14076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031400/0x8c5345f1c1ec6243 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e9a1 expref: 22 pid: 14076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240114.719024:0:14076:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030e00/0x8c5345f1c1ec624a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e9a1 expref: 21 pid: 14076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240114.719032:0:14076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bb5cfd09a00) 00010000:00010000:0.0:1782240114.719035:0:14076:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782240114.719038:0:14076:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5c0030e00, rc 0) 00000100:00100000:0.0:1782240114.719104:0:14076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f77f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+21:14430:x1868813738039936:12345-192.168.203.32@tcp:101:cat.0 Request processed in 473us (740us total) trans 8589934606 rc 0/0 00000100:00100000:0.0:1782240114.719128:0:14076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 33 00000100:00100000:0.0:1782240114.723234:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782240114.723320:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782240114.723683:0:14080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738040192 00000100:00100000:3.0:1782240114.723694:0:14080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738040192 00000100:00100000:3.0:1782240114.723787:0:14080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 8 00000100:00100000:3.0:1782240114.723796:0:14080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5eddf5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+21:14430:x1868813738040192:12345-192.168.203.32@tcp:35:cat.0 00000100:00100000:3.0:1782240114.724130:0:14080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5eddf5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+22:14430:x1868813738040192:12345-192.168.203.32@tcp:35:cat.0 Request processed in 333us (904us total) trans 8589934607 rc 0/0 00000100:00100000:3.0:1782240114.724138:0:14080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 8 00000100:00100000:1.0:1782240114.725349:0:14062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738040320 00000100:00100000:1.0:1782240114.725361:0:14062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738040320 00000100:00100000:1.0:1782240114.725425:0:14062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 1 00000100:00100000:1.0:1782240114.725435:0:14062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5eddf7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+22:2346:x1868813738040320:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782240114.725450:0:14062:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782240114.725479:0:14062:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030e00/0x8c5345f1c1ec624a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e9a1 expref: 22 pid: 14076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240114.725499:0:14062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bb5cfd09a00) 00010000:00010000:1.0:1782240114.725504:0:14062:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782240114.726033:0:14062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5eddf7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+21:2346:x1868813738040320:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 597us (2710us total) trans 0 rc 0/0 00000100:00100000:1.0:1782240114.726058:0:14062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 1 00000100:00100000:0.0:1782240114.810353:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782240114.810540:0:14077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738040576 00000100:00100000:2.0:1782240114.810551:0:14077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738040576 00000100:00100000:2.0:1782240114.810693:0:14077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 34 00000100:00100000:2.0:1782240114.810703:0:14077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5eddf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+21:14436:x1868813738040576:12345-192.168.203.32@tcp:101:dd.0 00010000:00010000:2.0:1782240114.810725:0:14077:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782240114.810745:0:14077:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019200/0x8c5345f1c1ec6258 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e9a8 expref: -99 pid: 14077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240114.811694:0:14077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019800/0x8c5345f1c1ec625f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240114.811715:0:14077:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030800/0x8c5345f1c1ec61fd lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e985 expref: 22 pid: 14077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240114.811723:0:14077:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2018c00/0x8c5345f1c1ec6212 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e98c expref: 22 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240114.811732:0:14077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019800/0x8c5345f1c1ec625f lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240114.811798:0:14077:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2018c00/0x8c5345f1c1ec6212 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e98c expref: 22 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240114.811812:0:14077:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2018c00/0x8c5345f1c1ec6212 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e98c expref: 22 pid: 15850 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782240114.811841:0:14077:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb6018cdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14077:1868813759000448:192.168.203.32@tcp:104: 00010000:00010000:2.0:1782240114.813211:0:14077:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030800/0x8c5345f1c1ec61fd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e985 expref: 22 pid: 14077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240114.813228:0:14077:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030800/0x8c5345f1c1ec61fd lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e985 expref: 22 pid: 14077 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782240114.813241:0:14077:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb6018ce680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14077:1868813759000576:192.168.203.32@tcp:104: 00000100:00100000:2.0:1782240114.813281:0:14077:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb601a1ccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1782240114.818153:0:14077:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb6018cdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14077:1868813759000448:192.168.203.32@tcp:104: 00000100:00100000:2.0:1782240114.818170:0:14077:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb6018ce680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14077:1868813759000576:192.168.203.32@tcp:104: 00010000:00010000:2.0:1782240114.818200:0:14077:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019800/0x8c5345f1c1ec625f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782240114.820428:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782240114.823252:0:14061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738040704 00000100:00100000:3.0:1782240114.823351:0:14061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738040704 00010000:00010000:3.0:1782240114.823397:0:14061:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2018c00/0x8c5345f1c1ec6212 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e98c expref: 23 pid: 15850 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782240114.823493:0:14061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 11 00000100:00100000:3.0:1782240114.823503:0:14061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5edc9d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+23:2345:x1868813738040704:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782240114.823521:0:14061:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782240114.823528:0:14061:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2018c00/0x8c5345f1c1ec6212 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e98c expref: 23 pid: 15850 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240114.823541:0:14061:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2018c00/0x8c5345f1c1ec6212 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e98c expref: 23 pid: 15850 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240114.823562:0:14061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2018c00/0x8c5345f1c1ec6212 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e98c expref: 23 pid: 15850 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240114.823580:0:14061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bb5cfd09a00) 00010000:00010000:3.0:1782240114.823586:0:14061:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019800/0x8c5345f1c1ec625f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240114.823596:0:14061:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019800/0x8c5345f1c1ec625f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240114.823614:0:14061:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782240114.823683:0:14061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5edc9d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+22:2345:x1868813738040704:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 180us (3262us total) trans 0 rc 0/0 00000100:00100000:3.0:1782240114.823691:0:14061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 11 00000100:00100000:0.0:1782240114.832330:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782240114.837087:0:14062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738040832 00000100:00100000:1.0:1782240114.837103:0:14062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738040832 00010000:00010000:1.0:1782240114.837154:0:14062:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030800/0x8c5345f1c1ec61fd lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e985 expref: 22 pid: 14077 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782240114.837284:0:14063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 12 00000100:00100000:2.0:1782240114.837299:0:14063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5eddf4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+22:2345:x1868813738040832:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782240114.837316:0:14063:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782240114.837324:0:14063:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030800/0x8c5345f1c1ec61fd lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e985 expref: 22 pid: 14077 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240114.837339:0:14063:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030800/0x8c5345f1c1ec61fd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e985 expref: 22 pid: 14077 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240114.837365:0:14063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030800/0x8c5345f1c1ec61fd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e985 expref: 22 pid: 14077 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240114.837397:0:14063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bb5cfd09a00) 00010000:00010000:2.0:1782240114.837402:0:14063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019800/0x8c5345f1c1ec625f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240114.837413:0:14063:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019800/0x8c5345f1c1ec625f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240114.837421:0:14063:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019800/0x8c5345f1c1ec625f lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240114.838314:0:14063:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782240114.838389:0:14063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5eddf4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+21:2345:x1868813738040832:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 1092us (6064us total) trans 0 rc 0/0 00000100:00100000:2.0:1782240114.838400:0:14063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 12 00010000:00010000:0.0:1782240114.846331:0:14077:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019800/0x8c5345f1c1ec625f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240114.846350:0:14077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019800/0x8c5345f1c1ec625f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782240114.846379:0:14077:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1782240114.846562:0:14077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019200/0x8c5345f1c1ec6258 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e9a8 expref: 22 pid: 14077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240114.846586:0:14077:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019800/0x8c5345f1c1ec625f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e9a8 expref: 21 pid: 14077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240114.846595:0:14077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bb5cfd09a00) 00010000:00010000:0.0:1782240114.846598:0:14077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1782240114.846614:0:14077:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb4c2019800, rc 0) 00000100:00100000:0.0:1782240114.846679:0:14077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5eddf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+21:14436:x1868813738040576:12345-192.168.203.32@tcp:101:dd.0 Request processed in 35977us (36337us total) trans 8589934608 rc 0/0 00000100:00100000:0.0:1782240114.846689:0:14077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 34 00000100:00100000:0.0:1782240114.853057:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782240114.853211:0:14076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738041088 00000100:00100000:3.0:1782240114.853230:0:14076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738041088 00000100:00100000:3.0:1782240114.853288:0:14076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 35 00000100:00100000:3.0:1782240114.853298:0:14076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5eddf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+21:14436:x1868813738041088:12345-192.168.203.32@tcp:36:dd.0 00010000:00010000:3.0:1782240114.853561:0:14076:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27e00/0x8c5345f1c1ec626d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240114.853579:0:14076:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27e00/0x8c5345f1c1ec626d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240114.853591:0:14076:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27e00/0x8c5345f1c1ec626d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14076 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782240114.854332:0:14076:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:3.0:1782240114.854366:0:14076:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000077c42ecb reply state 00000000a4646efd transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27e00/0x8c5345f1c1ec626d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14076 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782240114.854378:0:14076:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782240114.854481:0:14076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5eddf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+24:14436:x1868813738041088:12345-192.168.203.32@tcp:36:dd.0 Request processed in 1183us (1430us total) trans 8589934610 rc 0/0 00000100:00100000:3.0:1782240114.854489:0:14076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 35 00000020:00080000:3.0:1782240114.854494:0:14076:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1782240114.858558:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782240114.858910:0:14078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738041216 00000100:00100000:3.0:1782240114.858928:0:14078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738041216 00000100:00100000:3.0:1782240114.858990:0:14078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 36 00000100:00100000:3.0:1782240114.859001:0:14078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f77f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+24:14436:x1868813738041216:12345-192.168.203.32@tcp:101:dd.0 00010000:00010000:3.0:1782240114.859024:0:14078:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782240114.859044:0:14078:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26e00/0x8c5345f1c1ec6274 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e9af expref: -99 pid: 14078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240114.859101:0:14078:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26e00/0x8c5345f1c1ec6274 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e9af expref: 25 pid: 14078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240114.859130:0:14078:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26e00/0x8c5345f1c1ec6274 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e9af expref: 25 pid: 14078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240114.859150:0:14078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bb5cfd09a00) 00010000:00010000:3.0:1782240114.859154:0:14078:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782240114.859157:0:14078:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5f7e26e00, rc 0) 00000100:00100000:3.0:1782240114.859223:0:14078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f77f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+25:14436:x1868813738041216:12345-192.168.203.32@tcp:101:dd.0 Request processed in 224us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1782240114.859231:0:14078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 36 00010000:00010000:0.0:1782240114.860084:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27e00/0x8c5345f1c1ec626d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240114.860105:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27e00/0x8c5345f1c1ec626d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240114.860112:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27e00/0x8c5345f1c1ec626d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240114.860118:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f7e27e00 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:0.0:1782240114.860123:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27e00/0x8c5345f1c1ec626d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240114.860130:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27e00/0x8c5345f1c1ec626d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240114.860144:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bb5cfd09a00) 00010000:00010000:0.0:1782240114.860147:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782240114.860151:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27e00/0x8c5345f1c1ec626d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240114.860157:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27e00/0x8c5345f1c1ec626d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14076 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782240114.873831:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782240114.874017:0:14061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738041472 00000100:00100000:3.0:1782240114.874027:0:14061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738041472 00000100:00100000:3.0:1782240114.874094:0:14061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 2 00000100:00100000:3.0:1782240114.874103:0:14061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f77f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+24:14436:x1868813738041472:12345-192.168.203.32@tcp:103:dd.0 00010000:00010000:3.0:1782240114.874120:0:14061:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782240114.874145:0:14061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26e00/0x8c5345f1c1ec6274 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e9af expref: 24 pid: 14078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240114.874167:0:14061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bb5cfd09a00) 00010000:00010000:3.0:1782240114.874172:0:14061:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782240114.874226:0:14061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f77f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+23:14436:x1868813738041472:12345-192.168.203.32@tcp:103:dd.0 Request processed in 124us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1782240114.874234:0:14061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 2 00000100:00100000:1.0:1782240114.879900:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782240114.880202:0:15850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738041600 00000100:00100000:0.0:1782240114.880211:0:15850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738041600 00000100:00100000:0.0:1782240114.880267:0:15850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 37 00000100:00100000:0.0:1782240114.880275:0:15850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f77f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+23:14436:x1868813738041600:12345-192.168.203.32@tcp:58:dd.0 00010000:00010000:0.0:1782240114.880359:0:15850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031200/0x8c5345f1c1ec627b lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240114.880374:0:15850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031200/0x8c5345f1c1ec627b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240114.880400:0:15850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031200/0x8c5345f1c1ec627b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15850 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782240114.881323:0:15850:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1782240114.881471:0:15850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:0.0:1782240114.881530:0:15850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:0.0:1782240114.881829:0:15850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f77f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+23:14436:x1868813738041600:12345-192.168.203.32@tcp:58:dd.0 Request processed in 1549us (1933us total) trans 0 rc 0/0 00000100:00100000:0.0:1782240114.881840:0:15850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 37 00000100:00100000:0.0:1782240114.888430:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782240114.888546:0:14078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738041728 00000100:00100000:3.0:1782240114.888555:0:14078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738041728 00000100:00100000:3.0:1782240114.888619:0:14078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 38 00000100:00100000:3.0:1782240114.888628:0:14078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5eddf7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+23:14436:x1868813738041728:12345-192.168.203.32@tcp:101:dd.0 00010000:00010000:3.0:1782240114.888659:0:14078:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782240114.888680:0:14078:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26e00/0x8c5345f1c1ec6282 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e9b6 expref: -99 pid: 14078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240114.888734:0:14078:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031200/0x8c5345f1c1ec627b lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240114.888744:0:14078:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26e00/0x8c5345f1c1ec6282 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e9b6 expref: 24 pid: 14078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240114.888778:0:14078:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031200/0x8c5345f1c1ec627b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 15850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240114.888790:0:14078:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26e00/0x8c5345f1c1ec6282 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e9b6 expref: 24 pid: 14078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240114.888804:0:14078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bb5cfd09a00) 00010000:00010000:3.0:1782240114.888806:0:14078:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782240114.888810:0:14078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26e00/0x8c5345f1c1ec6282 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e9b6 expref: 24 pid: 14078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240114.888818:0:14078:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5f7e26e00, rc 0) 00000100:00100000:3.0:1782240114.888889:0:14078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5eddf7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+24:14436:x1868813738041728:12345-192.168.203.32@tcp:101:dd.0 Request processed in 261us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1782240114.888896:0:14078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 38 00010000:00010000:1.0:1782240115.175253:0:14064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1782240115.742995:0:14110:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1782240115.743004:0:14110:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1782240115.743037:0:14110:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1782240115.743054:0:14110:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1782240115.743178:0:14110:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f46fdc00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14110:1868813759000704:192.168.203.32@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1782240115.743461:0:14110:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c8460300 going to sleep for 11 seconds 00000100:00100000:3.0:1782240115.748163:0:14110:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f46fdc00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14110:1868813759000704:192.168.203.32@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1782240115.749113:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782240115.749351:0:14087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738041856 00000100:00100000:3.0:1782240115.749360:0:14087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738041856 00000100:00100000:3.0:1782240115.749439:0:14087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 0 00000100:00100000:3.0:1782240115.749451:0:14087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f77f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+24:14438:x1868813738041856:12345-192.168.203.32@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1782240115.749534:0:14087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f77f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+24:14438:x1868813738041856:12345-192.168.203.32@tcp:900:lhsmtool_posix.0 Request processed in 85us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1782240115.749543:0:14087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 0 00000100:00080000:1.0:1782240115.750076:0:14072:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782240115.752144:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782240115.752289:0:14076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738041984 00000100:00100000:3.0:1782240115.752298:0:14076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738041984 00000100:00100000:3.0:1782240115.752362:0:14076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 39 00000100:00100000:3.0:1782240115.752471:0:14076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5eddf6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+24:14438:x1868813738041984:12345-192.168.203.32@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1782240115.752502:0:14076:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1782240115.752649:0:14076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5eddf6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+24:14438:x1868813738041984:12345-192.168.203.32@tcp:53:lhsmtool_posix.0 Request processed in 181us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1782240115.752656:0:14076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 39 00000100:00100000:0.0:1782240115.757894:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782240115.758535:0:14078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738042112 00000100:00100000:3.0:1782240115.758546:0:14078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738042112 00000100:00100000:3.0:1782240115.758610:0:14078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 40 00000100:00100000:3.0:1782240115.758620:0:14078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5eddf5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+24:14438:x1868813738042112:12345-192.168.203.32@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1782240115.758693:0:14078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26400/0x8c5345f1c1ec6289 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240115.758728:0:14078:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26400/0x8c5345f1c1ec6289 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240115.758739:0:14078:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26400/0x8c5345f1c1ec6289 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240115.758782:0:14078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27e00/0x8c5345f1c1ec6290 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240115.758790:0:14078:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27e00/0x8c5345f1c1ec6290 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240115.758797:0:14078:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27e00/0x8c5345f1c1ec6290 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240115.758820:0:14078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26200/0x8c5345f1c1ec6297 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240115.758827:0:14078:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26200/0x8c5345f1c1ec6297 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240115.758834:0:14078:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26200/0x8c5345f1c1ec6297 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782240115.758869:0:14078:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1782240115.758873:0:14078:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782240115.758887:0:14078:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26200/0x8c5345f1c1ec6297 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240115.758897:0:14078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26400/0x8c5345f1c1ec6289 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240115.758924:0:14078:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26400/0x8c5345f1c1ec6289 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240115.758931:0:14078:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26400/0x8c5345f1c1ec6289 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240115.758937:0:14078:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f7e26400 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:3.0:1782240115.758942:0:14078:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26400/0x8c5345f1c1ec6289 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240115.758950:0:14078:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26400/0x8c5345f1c1ec6289 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240115.758963:0:14078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bb5c2e3a600) 00010000:00010000:3.0:1782240115.758966:0:14078:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782240115.758971:0:14078:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26400/0x8c5345f1c1ec6289 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240115.758977:0:14078:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26400/0x8c5345f1c1ec6289 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240115.758991:0:14078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27e00/0x8c5345f1c1ec6290 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240115.758997:0:14078:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27e00/0x8c5345f1c1ec6290 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240115.759002:0:14078:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27e00/0x8c5345f1c1ec6290 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240115.759007:0:14078:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f7e27e00 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:3.0:1782240115.759015:0:14078:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27e00/0x8c5345f1c1ec6290 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240115.759022:0:14078:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27e00/0x8c5345f1c1ec6290 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240115.759029:0:14078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9bb5d0df4c00) 00010000:00010000:3.0:1782240115.759032:0:14078:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782240115.759035:0:14078:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27e00/0x8c5345f1c1ec6290 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240115.759041:0:14078:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27e00/0x8c5345f1c1ec6290 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240115.759059:0:14078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26200/0x8c5345f1c1ec6297 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240115.759065:0:14078:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26200/0x8c5345f1c1ec6297 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240115.759071:0:14078:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26200/0x8c5345f1c1ec6297 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240115.759075:0:14078:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f7e26200 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:3.0:1782240115.759078:0:14078:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26200/0x8c5345f1c1ec6297 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240115.759083:0:14078:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26200/0x8c5345f1c1ec6297 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240115.759090:0:14078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bb5cfd09a00) 00010000:00010000:3.0:1782240115.759092:0:14078:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782240115.759102:0:14078:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26200/0x8c5345f1c1ec6297 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240115.759108:0:14078:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26200/0x8c5345f1c1ec6297 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782240115.759199:0:14078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5eddf5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+24:14438:x1868813738042112:12345-192.168.203.32@tcp:34:lhsmtool_posix.0 Request processed in 580us (1313us total) trans 0 rc 0/0 00000100:00100000:3.0:1782240115.759207:0:14078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 40 00000100:00100000:0.0:1782240115.765254:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782240115.765403:0:15850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738042368 00000100:00100000:2.0:1782240115.765413:0:15850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738042368 00000100:00100000:2.0:1782240115.765490:0:15850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 41 00000100:00100000:2.0:1782240115.765501:0:15850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5eddf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+24:14438:x1868813738042368:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782240115.765521:0:15850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782240115.765542:0:15850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019200/0x8c5345f1c1ec629e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e9bd expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240115.765665:0:15850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2018c00/0x8c5345f1c1ec62a5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240115.765681:0:15850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2018c00/0x8c5345f1c1ec62a5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240115.765704:0:15850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2018c00/0x8c5345f1c1ec62a5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782240115.765718:0:15850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1782240115.765861:0:15850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2018c00/0x8c5345f1c1ec62a5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240115.765869:0:15850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2018c00/0x8c5345f1c1ec62a5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240115.765877:0:15850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2018c00/0x8c5345f1c1ec62a5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240115.765882:0:15850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb4c2018c00 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:2.0:1782240115.765886:0:15850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2018c00/0x8c5345f1c1ec62a5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240115.765894:0:15850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2018c00/0x8c5345f1c1ec62a5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240115.765915:0:15850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bb5cfd09a00) 00010000:00010000:2.0:1782240115.765918:0:15850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1782240115.765922:0:15850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2018c00/0x8c5345f1c1ec62a5 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240115.765927:0:15850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2018c00/0x8c5345f1c1ec62a5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240115.765968:0:15850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019200/0x8c5345f1c1ec629e lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e9bd expref: 26 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240115.765988:0:15850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bb5c2e3a600) 00010000:00010000:2.0:1782240115.765990:0:15850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782240115.765994:0:15850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019200/0x8c5345f1c1ec629e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e9bd expref: 26 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240115.766003:0:15850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb4c2019200, rc 0) 00000100:00100000:2.0:1782240115.766053:0:15850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5eddf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+25:14438:x1868813738042368:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 554us (807us total) trans 8589934611 rc 301/301 00000100:00100000:2.0:1782240115.766060:0:15850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 41 00000100:00100000:1.0:1782240115.774860:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782240115.774988:0:14078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738042496 00000100:00100000:3.0:1782240115.774997:0:14078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738042496 00000100:00100000:3.0:1782240115.775047:0:14078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 42 00000100:00100000:3.0:1782240115.775057:0:14078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f77f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+25:14438:x1868813738042496:12345-192.168.203.32@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1782240115.775093:0:14078:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1782240115.775211:0:14078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f77f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+25:14438:x1868813738042496:12345-192.168.203.32@tcp:53:lhsmtool_posix.0 Request processed in 155us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1782240115.775219:0:14078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 42 00000100:00100000:0.0:1782240115.780165:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782240115.780275:0:15850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738042752 00000100:00100000:2.0:1782240115.780293:0:15850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738042752 00000100:00100000:2.0:1782240115.780353:0:15850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 43 00000100:00100000:2.0:1782240115.780363:0:15850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f4895180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+25:14438:x1868813738042752:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782240115.780394:0:15850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782240115.780416:0:15850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019200/0x8c5345f1c1ec62b3 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e9c4 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782240115.781202:0:15850:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x7:0x0], count =27 00000004:00080000:2.0:1782240115.781209:0:15850:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x7:0x0]+27 in llog 00000004:00080000:2.0:1782240115.781259:0:15850:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:2.0:1782240115.781507:0:15850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2018c00/0x8c5345f1c1ec62ba lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240115.781523:0:15850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2018c00/0x8c5345f1c1ec62ba lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240115.781534:0:15850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2018c00/0x8c5345f1c1ec62ba lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240115.781596:0:15850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019200/0x8c5345f1c1ec62b3 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e9c4 expref: 28 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240115.781614:0:15850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2018c00/0x8c5345f1c1ec62ba lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e9c4 expref: 27 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240115.781621:0:15850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9bb5c2e3ac00) 00010000:00010000:2.0:1782240115.781625:0:15850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782240115.781628:0:15850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb4c2018c00, rc 0) 00000100:00100000:2.0:1782240115.781702:0:15850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f4895180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+27:14438:x1868813738042752:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 1340us (1545us total) trans 8589934612 rc 0/0 00000100:00100000:2.0:1782240115.781711:0:15850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 43 00000100:00100000:1.0:1782240115.801740:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782240115.802101:0:14078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738043008 00000100:00100000:3.0:1782240115.802112:0:14078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738043008 00000100:00100000:3.0:1782240115.802170:0:14078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 44 00000100:00100000:3.0:1782240115.802180:0:14078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f77f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+27:14438:x1868813738043008:12345-192.168.203.32@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1782240115.802236:0:14078:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782240115.802262:0:14078:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2018c00/0x8c5345f1c1ec62ba lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e9c4 expref: 27 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240115.802292:0:14078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9bb5c2e3ac00) 00010000:00010000:3.0:1782240115.802303:0:14078:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782240115.802324:0:14078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26200/0x8c5345f1c1ec62c8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240115.802348:0:14078:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26200/0x8c5345f1c1ec62c8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240115.802358:0:14078:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26200/0x8c5345f1c1ec62c8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240115.802383:0:14078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27e00/0x8c5345f1c1ec62cf lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x326f0f44 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240115.802390:0:14078:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27e00/0x8c5345f1c1ec62cf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x326f0f44 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240115.802397:0:14078:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27e00/0x8c5345f1c1ec62cf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x326f0f44 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240115.802467:0:14078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26200/0x8c5345f1c1ec62c8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240115.802727:0:14078:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26200/0x8c5345f1c1ec62c8 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240115.802733:0:14078:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26200/0x8c5345f1c1ec62c8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240115.802738:0:14078:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f7e26200 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:3.0:1782240115.802743:0:14078:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26200/0x8c5345f1c1ec62c8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240115.802796:0:14078:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26200/0x8c5345f1c1ec62c8 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240115.802805:0:14078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bb5cfd09600) 00010000:00010000:3.0:1782240115.802814:0:14078:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782240115.802819:0:14078:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26200/0x8c5345f1c1ec62c8 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240115.802826:0:14078:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26200/0x8c5345f1c1ec62c8 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240115.802840:0:14078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27e00/0x8c5345f1c1ec62cf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x326f0f44 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240115.802845:0:14078:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27e00/0x8c5345f1c1ec62cf lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x326f0f44 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240115.802851:0:14078:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27e00/0x8c5345f1c1ec62cf lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x326f0f44 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240115.802855:0:14078:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f7e27e00 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:3.0:1782240115.802858:0:14078:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27e00/0x8c5345f1c1ec62cf lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x326f0f44 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240115.802863:0:14078:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27e00/0x8c5345f1c1ec62cf lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x326f0f44 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240115.802871:0:14078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x326f0f44 (ffff9bb5d0df4c00) 00010000:00010000:3.0:1782240115.802874:0:14078:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782240115.802877:0:14078:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27e00/0x8c5345f1c1ec62cf lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x326f0f44 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240115.802882:0:14078:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e27e00/0x8c5345f1c1ec62cf lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x326f0f44 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14078 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782240115.802966:0:14078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f77f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+26:14438:x1868813738043008:12345-192.168.203.32@tcp:36:lhsmtool_posix.0 Request processed in 786us (1234us total) trans 0 rc -2/-2 00000100:00100000:3.0:1782240115.802979:0:14078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 44 00000100:00100000:1.0:1782240115.812995:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782240115.813554:0:15850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738043136 00000100:00100000:2.0:1782240115.813568:0:15850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738043136 00000100:00100000:2.0:1782240115.813647:0:15850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 45 00000100:00100000:2.0:1782240115.813658:0:15850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f77f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+26:14438:x1868813738043136:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782240115.813680:0:15850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782240115.813703:0:15850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019200/0x8c5345f1c1ec62d6 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e9cb expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240115.813738:0:15850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019c00/0x8c5345f1c1ec62dd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240115.813766:0:15850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019c00/0x8c5345f1c1ec62dd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240115.813778:0:15850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019c00/0x8c5345f1c1ec62dd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240115.813895:0:15850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019200/0x8c5345f1c1ec62d6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e9cb expref: 28 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240115.813924:0:15850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019c00/0x8c5345f1c1ec62dd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e9cb expref: 27 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240115.813933:0:15850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9bb5c2e3a900) 00010000:00010000:2.0:1782240115.813936:0:15850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1782240115.813942:0:15850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb4c2019c00, rc 0) 00000100:00100000:2.0:1782240115.814018:0:15850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f77f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+27:14438:x1868813738043136:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 360us (1030us total) trans 0 rc 0/0 00000100:00100000:2.0:1782240115.814026:0:15850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 45 00000100:00100000:0.0:1782240115.822788:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782240115.822876:0:14077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738043392 00000100:00100000:2.0:1782240115.822885:0:14077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738043392 00000100:00100000:2.0:1782240115.822951:0:14077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 46 00000100:00100000:2.0:1782240115.822961:0:14077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f4894000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+27:14438:x1868813738043392:12345-192.168.203.32@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1782240115.823039:0:14077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019200/0x8c5345f1c1ec62e4 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240115.823057:0:14077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019200/0x8c5345f1c1ec62e4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240115.823068:0:14077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019200/0x8c5345f1c1ec62e4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782240115.823554:0:14077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:2.0:1782240115.823565:0:14077:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 494895816546ns, next at 495895814131ns, rc = 0 00000004:00010000:2.0:1782240115.823668:0:14077:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009cbfc8ba reply state 00000000e6306da2 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019200/0x8c5345f1c1ec62e4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782240115.823677:0:14077:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782240115.823860:0:14077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f4894000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+29:14438:x1868813738043392:12345-192.168.203.32@tcp:36:lhsmtool_posix.0 Request processed in 899us (1111us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1782240115.823869:0:14077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 46 00000100:00100000:3.0:1782240115.834030:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00010000:00010000:0.0:1782240115.835016:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019200/0x8c5345f1c1ec62e4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240115.835030:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019200/0x8c5345f1c1ec62e4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240115.835038:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019200/0x8c5345f1c1ec62e4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240115.835044:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb4c2019200 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:0.0:1782240115.835049:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019200/0x8c5345f1c1ec62e4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240115.835055:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019200/0x8c5345f1c1ec62e4 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240115.835089:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9bb5c2e3a900) 00010000:00010000:0.0:1782240115.835091:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1782240115.835096:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019200/0x8c5345f1c1ec62e4 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240115.835102:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2019200/0x8c5345f1c1ec62e4 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782240115.835585:0:14076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738043520 00000100:00100000:1.0:1782240115.835603:0:14076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738043520 00000100:00100000:1.0:1782240115.835671:0:14076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 47 00000100:00100000:1.0:1782240115.835681:0:14076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f46fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+28:14438:x1868813738043520:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782240115.835704:0:14076:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782240115.835722:0:14076:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39200/0x8c5345f1c1ec62eb lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e9d2 expref: -99 pid: 14076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240115.835810:0:14076:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39200/0x8c5345f1c1ec62eb lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e9d2 expref: 29 pid: 14076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240115.835825:0:14076:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39200/0x8c5345f1c1ec62eb lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e9d2 expref: 29 pid: 14076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240115.835880:0:14076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9bb5c2e3a900) 00010000:00010000:0.0:1782240115.835885:0:14076:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782240115.835887:0:14076:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5f7e39200, rc 0) 00000100:00100000:0.0:1782240115.835971:0:14076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f46fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+29:14438:x1868813738043520:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 290us (1949us total) trans 0 rc 0/0 00000100:00100000:0.0:1782240115.835978:0:14076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 47 00000100:00100000:1.0:1782240115.839578:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782240115.839719:0:14712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738043648 00000100:00100000:3.0:1782240115.839728:0:14712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738043648 00000100:00100000:3.0:1782240115.839824:0:14712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 12 00000100:00100000:3.0:1782240115.839833:0:14712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f77f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+5:2345:x1868813738043648:12345-192.168.203.32@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1782240115.840184:0:14712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f77f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+6:2345:x1868813738043648:12345-192.168.203.32@tcp:2:lhsmtool_posix.0 Request processed in 350us (613us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1782240115.840192:0:14712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 12 00000100:00100000:1.0:1782240115.844847:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782240115.844992:0:14080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738043904 00000100:00100000:3.0:1782240115.845002:0:14080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738043904 00000100:00100000:3.0:1782240115.845060:0:14080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 9 00000100:00100000:3.0:1782240115.845071:0:14080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f77f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+29:14438:x1868813738043904:12345-192.168.203.32@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1782240115.845326:0:14080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f77f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+30:14438:x1868813738043904:12345-192.168.203.32@tcp:35:lhsmtool_posix.0 Request processed in 256us (487us total) trans 8589934614 rc 0/0 00000100:00100000:3.0:1782240115.845335:0:14080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 9 00000100:00100000:1.0:1782240115.850584:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782240115.853321:0:14078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738044160 00000100:00100000:3.0:1782240115.853338:0:14078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738044160 00000100:00100000:2.0:1782240115.859495:0:14078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 48 00000100:00100000:2.0:1782240115.859518:0:14078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f77f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+30:14438:x1868813738044160:12345-192.168.203.32@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1782240115.859643:0:14078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f77f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+30:14438:x1868813738044160:12345-192.168.203.32@tcp:57:lhsmtool_posix.0 Request processed in 135us (9068us total) trans 0 rc 0/0 00000100:00100000:2.0:1782240115.859652:0:14078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 48 00000100:00100000:1.0:1782240115.866804:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782240115.880246:0:14077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738044288 00000100:00100000:0.0:1782240115.880260:0:14077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738044288 00000100:00100000:0.0:1782240115.880467:0:14077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 49 00000100:00100000:0.0:1782240115.880490:0:14077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f77f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+30:14438:x1868813738044288:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782240115.880511:0:14077:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782240115.880534:0:14077:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031800/0x8c5345f1c1ec62f2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e9d9 expref: -99 pid: 14077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240115.880852:0:14077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031000/0x8c5345f1c1ec62f9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240115.880868:0:14077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031000/0x8c5345f1c1ec62f9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240115.880878:0:14077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031000/0x8c5345f1c1ec62f9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782240115.880945:0:14077:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782240115.880968:0:14077:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031000/0x8c5345f1c1ec62f9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240115.881002:0:14077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031800/0x8c5345f1c1ec62f2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e9d9 expref: 32 pid: 14077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240115.881021:0:14077:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031000/0x8c5345f1c1ec62f9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e9d9 expref: 31 pid: 14077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240115.881030:0:14077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9bb5c2e3a900) 00010000:00010000:0.0:1782240115.881033:0:14077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1782240115.881037:0:14077:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb5c0031000, rc 0) 00000100:00100000:0.0:1782240115.881099:0:14077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f77f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+31:14438:x1868813738044288:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 610us (14303us total) trans 0 rc 0/0 00000100:00100000:0.0:1782240115.881106:0:14077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 49 00000100:00100000:0.0:1782240115.889991:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782240115.890063:0:14714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738044416 00000100:00100000:2.0:1782240115.890074:0:14714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738044416 00000100:00100000:2.0:1782240115.890126:0:14714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 13 00000100:00100000:2.0:1782240115.890141:0:14714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f4895500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+6:2345:x1868813738044416:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782240115.890159:0:14714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782240115.890187:0:14714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000a7c1c8c/0x8c5345f1c1ec6300 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc49095c69f28e9e0 expref: -99 pid: 14714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782240115.890213:0:14714:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a3ad373, blocks: 0x1 00010000:00010000:2.0:1782240115.890232:0:14714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=494s v=(0 0) 00010000:00010000:2.0:1782240115.890237:0:14714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782240115.890247:0:14714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a7c1c8c/0x8c5345f1c1ec6300 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e9e0 expref: 7 pid: 14714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240115.890285:0:14714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000a7c1c8c/0x8c5345f1c1ec6300 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e9e0 expref: 7 pid: 14714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240115.890297:0:14714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb4c2019600, rc 0) 00000100:00100000:2.0:1782240115.890358:0:14714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f4895500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+7:2345:x1868813738044416:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 224us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1782240115.890365:0:14714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 13 00000100:00100000:0.0:1782240115.895550:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782240115.895629:0:15850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738044672 00000100:00100000:1.0:1782240115.895639:0:15850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738044672 00000100:00100000:1.0:1782240115.895705:0:15850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 50 00000100:00100000:1.0:1782240115.895715:0:15850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f4895f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+31:14438:x1868813738044672:12345-192.168.203.32@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1782240115.895828:0:15850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f4895f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+31:14438:x1868813738044672:12345-192.168.203.32@tcp:57:lhsmtool_posix.0 Request processed in 115us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1782240115.895835:0:15850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 50 00000100:00100000:0.0:1782240115.903302:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782240115.903385:0:14076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738044800 00000100:00100000:3.0:1782240115.903396:0:14076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738044800 00000100:00100000:3.0:1782240115.903460:0:14076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 51 00000100:00100000:3.0:1782240115.903480:0:14076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc2aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+31:14438:x1868813738044800:12345-192.168.203.32@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1782240115.989406:0:14076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc2aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+31:14438:x1868813738044800:12345-192.168.203.32@tcp:44:lhsmtool_posix.0 Request processed in 85926us (86103us total) trans 0 rc 0/0 00000100:00100000:0.0:1782240115.989419:0:14076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 51 00000001:00080000:1.0:1782240115.989794:0:5812:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934608 is committed 00000001:00080000:1.0:1782240115.989809:0:5812:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934598 is committed 00000001:00080000:1.0:1782240115.989820:0:5812:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934613 is committed 00000004:00080000:1.0:1782240115.989825:0:5812:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:1.0:1782240115.989854:0:5812:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000001:00080000:1.0:1782240115.989863:0:5812:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000100:00100000:0.0:1782240115.990261:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb6018ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1868813759000832:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1782240115.990313:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782240115.990548:0:14712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813759000832 00000100:00100000:2.0:1782240115.990555:0:14712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813759000832 00000100:00100000:2.0:1782240115.990617:0:14712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1782240115.990626:0:14712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7811500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1868813759000832:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1782240115.990800:0:14712:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1782240115.990804:0:14712:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1782240115.990806:0:14712:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1782240115.990808:0:14712:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1782240115 -> 1782240115 00002000:00010000:2.0:1782240115.990810:0:14712:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1782240115.990848:0:14712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7811500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1868813759000832:12345-0@lo:2:osp-syn-0-0.0 Request processed in 223us (534us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1782240115.990855:0:14712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1782240115.991121:0:14072:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1782240115.991206:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bb6018ce680/2, rc 0, transno 8589934595 00000100:00100000:0.0:1782240115.991212:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb6018ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1868813759000832:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1782240115.993592:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782240115.993687:0:14714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738044928 00000100:00100000:2.0:1782240115.993696:0:14714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738044928 00000100:00100000:2.0:1782240115.993783:0:14714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 15 00000100:00100000:2.0:1782240115.993791:0:14714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7810e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+7:2345:x1868813738044928:12345-192.168.203.32@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1782240115.993872:0:14714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7810e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+7:2345:x1868813738044928:12345-192.168.203.32@tcp:16:lhsmtool_posix.0 Request processed in 82us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1782240115.993965:0:14714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 15 00000100:00100000:2.0:1782240115.996075:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782240115.996191:0:15850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738045184 00000100:00100000:1.0:1782240115.996199:0:15850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738045184 00000100:00100000:1.0:1782240115.996252:0:15850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 52 00000100:00100000:1.0:1782240115.996262:0:15850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb6018cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+14:14438:x1868813738045184:12345-192.168.203.32@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1782240115.996322:0:15850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782240115.996360:0:15850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031000/0x8c5345f1c1ec62f9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e9d9 expref: 14 pid: 14077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240115.996394:0:15850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9bb5c2e3a900) 00010000:00010000:1.0:1782240115.996404:0:15850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782240115.996439:0:15850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38400/0x8c5345f1c1ec6307 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240115.996452:0:15850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38400/0x8c5345f1c1ec6307 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240115.996465:0:15850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38400/0x8c5345f1c1ec6307 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782240115.996721:0:15850:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004be26c4f reply state 0000000045ddf4c9 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38400/0x8c5345f1c1ec6307 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782240115.996730:0:15850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782240115.999053:0:15850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb6018cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+15:14438:x1868813738045184:12345-192.168.203.32@tcp:36:lhsmtool_posix.0 Request processed in 613us (806us total) trans 8589934615 rc 0/0 00000100:00100000:1.0:1782240115.999074:0:15850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 52 00000100:00100000:0.0:1782240116.000152:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782240116.000733:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782240116.000772:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb6018cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813759000960:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782240116.000821:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782240116.000902:0:14712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738045312 00000100:00100000:3.0:1782240116.000917:0:14712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738045312 00000100:00100000:3.0:1782240116.000959:0:14712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 16 00000100:00100000:3.0:1782240116.000966:0:14712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7811f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+7:2344:x1868813738045312:12345-192.168.203.32@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1782240116.001151:0:14712:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1782240116.001155:0:14712:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1782240114 00002000:00010000:3.0:1782240116.001157:0:14712:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1782240114 00002000:00010000:3.0:1782240116.001159:0:14712:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1782240115 -> 1782240114 00002000:00010000:3.0:1782240116.001162:0:14712:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1782240116.001222:0:14712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7811f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+8:2344:x1868813738045312:12345-192.168.203.32@tcp:2:lhsmtool_posix.0 Request processed in 254us (1075us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1782240116.001230:0:14712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 16 00000100:00100000:2.0:1782240116.001839:0:14716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813759000960 00000100:00100000:2.0:1782240116.001845:0:14716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813759000960 00000100:00100000:2.0:1782240116.001894:0:14716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1782240116.001902:0:14716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f46fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1868813759000960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782240116.001940:0:14716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782240116.001990:0:14716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f46fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1868813759000960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (1168us total) trans 0 rc 0/0 00000100:00100000:2.0:1782240116.001997:0:14716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1782240116.002283:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb6018cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1868813759000960:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1782240116.002426:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38400/0x8c5345f1c1ec6307 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240116.002438:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38400/0x8c5345f1c1ec6307 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240116.002446:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38400/0x8c5345f1c1ec6307 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240116.002452:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f7e38400 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:1.0:1782240116.002457:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38400/0x8c5345f1c1ec6307 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240116.002477:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38400/0x8c5345f1c1ec6307 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240116.002493:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9bb5c2e3a900) 00010000:00010000:1.0:1782240116.002496:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782240116.002501:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38400/0x8c5345f1c1ec6307 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240116.002507:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e38400/0x8c5345f1c1ec6307 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782240116.008495:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782240116.008601:0:14714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738045440 00000100:00100000:2.0:1782240116.008611:0:14714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738045440 00000100:00100000:2.0:1782240116.008704:0:14714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 17 00000100:00100000:2.0:1782240116.008715:0:14714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7811880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+8:2345:x1868813738045440:12345-192.168.203.32@tcp:1:lhsmtool_posix.0 00000100:00080000:1.0:1782240116.008876:0:14072:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1782240116.008958:0:14714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000855e9b8a/0x8c5345f1c1ec630e lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240116.008975:0:14714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1782240116.008979:0:14714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782240116.008986:0:14714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000855e9b8a/0x8c5345f1c1ec630e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240116.009002:0:14714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000855e9b8a/0x8c5345f1c1ec630e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240116.009029:0:14714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000855e9b8a/0x8c5345f1c1ec630e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240116.009046:0:14714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000855e9b8a/0x8c5345f1c1ec630e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240116.009052:0:14714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000855e9b8a/0x8c5345f1c1ec630e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240116.009057:0:14714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb4c2018800 already unused, calling callback (ffffffffc1728ce0) 00010000:00010000:2.0:1782240116.009060:0:14714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000855e9b8a/0x8c5345f1c1ec630e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240116.009065:0:14714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000855e9b8a/0x8c5345f1c1ec630e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240116.009076:0:14714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000855e9b8a/0x8c5345f1c1ec630e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240116.009080:0:14714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000855e9b8a/0x8c5345f1c1ec630e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782240116.009137:0:14714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7811880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+8:2345:x1868813738045440:12345-192.168.203.32@tcp:1:lhsmtool_posix.0 Request processed in 424us (650us total) trans 0 rc 0/0 00000100:00100000:2.0:1782240116.009145:0:14714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 17 00000100:00100000:3.0:1782240116.011699:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782240116.011810:0:14077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738045696 00000100:00100000:0.0:1782240116.011819:0:14077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738045696 00000100:00100000:0.0:1782240116.011956:0:14077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 53 00000100:00100000:0.0:1782240116.011968:0:14077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f46fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+14:14438:x1868813738045696:12345-192.168.203.32@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1782240116.012050:0:14077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031e00/0x8c5345f1c1ec6315 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240116.012067:0:14077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031e00/0x8c5345f1c1ec6315 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240116.012079:0:14077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031e00/0x8c5345f1c1ec6315 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240116.012513:0:14077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030400/0x8c5345f1c1ec631c lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240116.012526:0:14077:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39200/0x8c5345f1c1ec62eb lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e9d2 expref: 15 pid: 14076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240116.012535:0:14077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030400/0x8c5345f1c1ec631c lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240116.012566:0:14077:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39200/0x8c5345f1c1ec62eb lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e9d2 expref: 15 pid: 14076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240116.012581:0:14077:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39200/0x8c5345f1c1ec62eb lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e9d2 expref: 15 pid: 14076 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782240116.012608:0:14077:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f7813100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14077:1868813759001088:192.168.203.32@tcp:104: 00000100:00100000:0.0:1782240116.012690:0:14077:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c2c79480 going to sleep for 11 seconds 00000100:00100000:0.0:1782240116.018101:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782240116.018256:0:14063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738045824 00000100:00100000:1.0:1782240116.018265:0:14063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738045824 00010000:00010000:1.0:1782240116.018361:0:14063:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39200/0x8c5345f1c1ec62eb lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e9d2 expref: 16 pid: 14076 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782240116.018388:0:14077:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f7813100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14077:1868813759001088:192.168.203.32@tcp:104: 00010000:00010000:2.0:1782240116.018413:0:14077:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030400/0x8c5345f1c1ec631c lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782240116.018441:0:14063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 13 00000100:00100000:1.0:1782240116.018451:0:14063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7812680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+16:2344:x1868813738045824:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782240116.018469:0:14063:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782240116.018477:0:14063:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39200/0x8c5345f1c1ec62eb lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e9d2 expref: 16 pid: 14076 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240116.018488:0:14063:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39200/0x8c5345f1c1ec62eb lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e9d2 expref: 16 pid: 14076 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240116.018509:0:14063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e39200/0x8c5345f1c1ec62eb lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e9d2 expref: 16 pid: 14076 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240116.018534:0:14063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9bb5c2e3a900) 00010000:00010000:1.0:1782240116.018548:0:14063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030400/0x8c5345f1c1ec631c lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240116.018558:0:14063:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030400/0x8c5345f1c1ec631c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240116.018565:0:14063:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030400/0x8c5345f1c1ec631c lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240116.018594:0:14063:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782240116.018690:0:14063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7812680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+15:2344:x1868813738045824:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 240us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1782240116.018699:0:14063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 13 00010000:00010000:2.0:1782240116.018765:0:14077:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030400/0x8c5345f1c1ec631c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240116.018773:0:14077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030400/0x8c5345f1c1ec631c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782240116.018954:0:14077:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:2.0:1782240116.019101:0:14077:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:2.0:1782240116.019142:0:14077:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:2.0:1782240116.019215:0:14077:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb6018cc700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14077:1868813759001216:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1782240116.019371:0:14077:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782240116.019397:0:14077:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb601a1c240 going to sleep for 11 seconds 00000100:00100000:2.0:1782240116.020603:0:14081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813759001216 00000100:00100000:2.0:1782240116.020614:0:14081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813759001216 00000100:00100000:2.0:1782240116.020662:0:14081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782240116.020672:0:14081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb6018ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14077:x1868813759001216:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1782240116.020789:0:14081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb6018ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14077:x1868813759001216:12345-0@lo:1000:mdt00_001.0 Request processed in 118us (1417us total) trans 0 rc 0/0 00000100:00100000:2.0:1782240116.020796:0:14081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782240116.020839:0:14077:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb6018cc700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14077:1868813759001216:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1782240116.021530:0:14077:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:2.0:1782240116.021613:0:14077:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb6018cc700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14077:1868813759001344:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1782240116.021654:0:14077:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782240116.021680:0:14081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813759001344 00000100:00100000:2.0:1782240116.021684:0:14081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813759001344 00000100:00100000:2.0:1782240116.021709:0:14081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782240116.021716:0:14081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb6018ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14077:x1868813759001344:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1782240116.021880:0:14081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb6018ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14077:x1868813759001344:12345-0@lo:1000:mdt00_001.0 Request processed in 164us (224us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1782240116.021887:0:14081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782240116.021919:0:14077:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb601a1c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782240116.021942:0:14077:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb6018cc700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14077:1868813759001344:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1782240116.021973:0:14077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030400/0x8c5345f1c1ec631c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240116.021983:0:14077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030400/0x8c5345f1c1ec631c lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240116.021989:0:14077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030400/0x8c5345f1c1ec631c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240116.021994:0:14077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5c0030400 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:2.0:1782240116.021998:0:14077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030400/0x8c5345f1c1ec631c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240116.022004:0:14077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030400/0x8c5345f1c1ec631c lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240116.022020:0:14077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9bb5c2e3a900) 00010000:00010000:2.0:1782240116.022023:0:14077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782240116.022027:0:14077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030400/0x8c5345f1c1ec631c lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240116.022032:0:14077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0030400/0x8c5345f1c1ec631c lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240116.022061:0:14077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031200/0x8c5345f1c1ec627b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 15850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240116.022075:0:14077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031200/0x8c5345f1c1ec627b lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 15850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240116.022081:0:14077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031200/0x8c5345f1c1ec627b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 15850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240116.022085:0:14077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5c0031200 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:2.0:1782240116.022088:0:14077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031200/0x8c5345f1c1ec627b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 15850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240116.022094:0:14077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031200/0x8c5345f1c1ec627b lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 15850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240116.022102:0:14077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bb5cfd09a00) 00010000:00010000:2.0:1782240116.022104:0:14077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782240116.022110:0:14077:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26e00/0x8c5345f1c1ec6282 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e9b6 expref: 18 pid: 14078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240116.022121:0:14077:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26e00/0x8c5345f1c1ec6282 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e9b6 expref: 18 pid: 14078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240116.022130:0:14077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26e00/0x8c5345f1c1ec6282 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e9b6 expref: 18 pid: 14078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240116.022192:0:14077:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26e00/0x8c5345f1c1ec6282 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e9b6 expref: 18 pid: 14078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782240116.022204:0:14077:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb6018cc000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14077:1868813759001472:192.168.203.32@tcp:105: 00000100:00100000:2.0:1782240116.022273:0:14077:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb5c875d000 going to sleep for 11 seconds 00000100:00100000:2.0:1782240116.025110:0:14077:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb6018cc000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14077:1868813759001472:192.168.203.32@tcp:105: 00010000:00010000:2.0:1782240116.025140:0:14077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031200/0x8c5345f1c1ec627b lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 15850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240116.025151:0:14077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031200/0x8c5345f1c1ec627b lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 15850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782240116.025391:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782240116.025459:0:14080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738045952 00000100:00100000:3.0:1782240116.025465:0:14080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738045952 00000100:00100000:3.0:1782240116.025525:0:14080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 10 00000100:00100000:3.0:1782240116.025534:0:14080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f4422c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+19:14436:x1868813738045952:12345-192.168.203.32@tcp:49:dd.0 00000100:00100000:3.0:1782240116.025657:0:14080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f4422c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+19:14436:x1868813738045952:12345-192.168.203.32@tcp:49:dd.0 Request processed in 123us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1782240116.025664:0:14080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 10 00010000:00010000:2.0:1782240116.025740:0:14077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2018800/0x8c5345f1c1ec6323 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240116.025782:0:14077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2018800/0x8c5345f1c1ec6323 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240116.025793:0:14077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2018800/0x8c5345f1c1ec6323 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240116.025803:0:14077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2018800/0x8c5345f1c1ec6323 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240116.025809:0:14077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2018800/0x8c5345f1c1ec6323 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240116.025816:0:14077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2018800/0x8c5345f1c1ec6323 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240116.025822:0:14077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb4c2018800 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:2.0:1782240116.025826:0:14077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2018800/0x8c5345f1c1ec6323 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240116.025834:0:14077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2018800/0x8c5345f1c1ec6323 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240116.025863:0:14077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bb5cfd09a00) 00010000:00010000:2.0:1782240116.025866:0:14077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782240116.025870:0:14077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2018800/0x8c5345f1c1ec6323 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240116.025876:0:14077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb4c2018800/0x8c5345f1c1ec6323 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240116.025886:0:14077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031e00/0x8c5345f1c1ec6315 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240116.025893:0:14077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031e00/0x8c5345f1c1ec6315 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240116.025898:0:14077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031e00/0x8c5345f1c1ec6315 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240116.025914:0:14077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5c0031e00 already unused, calling callback (ffffffffc212f4f0) 00010000:00010000:2.0:1782240116.025917:0:14077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031e00/0x8c5345f1c1ec6315 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240116.025923:0:14077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031e00/0x8c5345f1c1ec6315 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240116.025930:0:14077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bb5cfd09a00) 00010000:00010000:2.0:1782240116.025933:0:14077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1782240116.025935:0:14077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031e00/0x8c5345f1c1ec6315 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240116.025941:0:14077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5c0031e00/0x8c5345f1c1ec6315 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14077 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782240116.026136:0:14077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f46fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+18:14438:x1868813738045696:12345-192.168.203.32@tcp:57:lhsmtool_posix.0 Request processed in 14169us (14443us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1782240116.026144:0:14077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 53 00000020:00080000:2.0:1782240116.026147:0:14077:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1782240116.026688:0:14110:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1782240116.026693:0:14110:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1782240116.026738:0:14110:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1782240116.026775:0:14110:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1782240116.032627:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782240116.034808:0:14080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738046208 00000100:00100000:3.0:1782240116.034836:0:14080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738046208 00000100:00100000:3.0:1782240116.034917:0:14080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 11 00000100:00100000:3.0:1782240116.034928:0:14080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7813800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+18:14438:x1868813738046208:12345-192.168.203.32@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1782240116.035621:0:14080:0:(mdd_object.c:4010:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1782240116.035722:0:14080:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:3.0:1782240116.035821:0:14080:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26400/0x8c5345f1c1ec632a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14080 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240116.035837:0:14080:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26400/0x8c5345f1c1ec632a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14080 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240116.035848:0:14080:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26400/0x8c5345f1c1ec632a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14080 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240116.035857:0:14080:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26400/0x8c5345f1c1ec632a lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14080 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240116.035863:0:14080:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26400/0x8c5345f1c1ec632a lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14080 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240116.035869:0:14080:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26400/0x8c5345f1c1ec632a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14080 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240116.035889:0:14080:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1782240116.035992:0:14080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7813800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+20:14438:x1868813738046208:12345-192.168.203.32@tcp:35:lhsmtool_posix.0 Request processed in 1064us (3371us total) trans 8589934622 rc 0/0 00000100:00100000:3.0:1782240116.036002:0:14080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 11 00000020:00080000:3.0:1782240116.036007:0:14080:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1782240116.036819:0:14065:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782240116.036827:0:14065:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26400/0x8c5345f1c1ec632a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14080 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240116.036835:0:14065:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f7e26400 already unused, calling callback (ffffffffc1728ce0) 00010000:00010000:1.0:1782240116.036840:0:14065:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26400/0x8c5345f1c1ec632a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14080 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240116.036848:0:14065:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26400/0x8c5345f1c1ec632a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14080 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240116.036862:0:14065:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9bb5c2e3a900) 00010000:00010000:1.0:1782240116.036865:0:14065:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1782240116.036869:0:14065:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26400/0x8c5345f1c1ec632a lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14080 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240116.036889:0:14065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb5f7e26400/0x8c5345f1c1ec632a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14080 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240116.036912:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782240116.036914:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782240116.036916:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782240116.190453:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782240116.190559:0:14717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738046336 00000100:00100000:3.0:1782240116.190568:0:14717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738046336 00000100:00100000:3.0:1782240116.190629:0:14717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 0 00000100:00100000:3.0:1782240116.190654:0:14717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f77f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+8:2347:x1868813738046336:12345-192.168.203.32@tcp:4:dd.0 00010000:00010000:3.0:1782240116.190691:0:14717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008dc71fd5/0x8c5345f1c1ec6331 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240116.190710:0:14717:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000a7c1c8c/0x8c5345f1c1ec6300 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e9e0 expref: 8 pid: 14714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240116.190718:0:14717:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782240116.190722:0:14717:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782240116.190727:0:14717:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008dc71fd5/0x8c5345f1c1ec6331 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240116.190810:0:14717:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000a7c1c8c/0x8c5345f1c1ec6300 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e9e0 expref: 8 pid: 14714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240116.190824:0:14717:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000a7c1c8c/0x8c5345f1c1ec6300 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e9e0 expref: 8 pid: 14714 timeout: 595 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782240116.190839:0:14717:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f46fd880 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0000_UUID:14717:1868813759001600:192.168.203.32@tcp:104: 00000100:00100000:3.0:1782240116.190937:0:14717:0:(client.c:2701:ptlrpc_set_wait()) set ffff9bb601a10e40 going to sleep for 11 seconds 00010000:00010000:1.0:1782240116.191202:0:14064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782240116.201238:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782240116.201276:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782240116.201306:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782240116.201318:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1782240116.201332:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1782240116.201487:0:14718:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1782240116.201497:0:14718:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:3.0:1782240116.208798:0:14719:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1782240116.208821:0:14719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738046464 00000100:00100000:3.0:1782240116.208830:0:14719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738046464 00000100:00100000:3.0:1782240116.208877:0:14719:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1782240116.208884:0:14719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738046592 00000100:00100000:3.0:1782240116.208887:0:14719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738046592 00000100:00100000:3.0:1782240116.208902:0:14719:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1782240116.208929:0:14719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738046848 00000100:00100000:3.0:1782240116.208933:0:14719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738046848 00000100:00100000:3.0:1782240116.208950:0:14719:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1782240116.208955:0:14719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738046720 00000100:00100000:3.0:1782240116.208958:0:14719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738046720 00000100:00100000:3.0:1782240116.208970:0:14719:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1782240116.208974:0:14719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738046976 00000100:00100000:3.0:1782240116.208976:0:14719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738046976 00000100:00100000:1.0:1782240116.211101:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782240116.211137:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782240116.211210:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1782240116.211239:0:14062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738047232 00000100:00100000:1.0:1782240116.211245:0:14062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738047232 00010000:00010000:1.0:1782240116.211282:0:14062:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000a7c1c8c/0x8c5345f1c1ec6300 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e9e0 expref: 14 pid: 14714 timeout: 595 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782240116.211313:0:14062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 14 00000100:00100000:1.0:1782240116.211321:0:14062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f77f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+14:2345:x1868813738047232:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782240116.211335:0:14062:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782240116.211369:0:14062:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000a7c1c8c/0x8c5345f1c1ec6300 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e9e0 expref: 14 pid: 14714 timeout: 595 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240116.211382:0:14062:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000a7c1c8c/0x8c5345f1c1ec6300 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e9e0 expref: 14 pid: 14714 timeout: 595 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240116.211406:0:14062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782240116.211425:0:14062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782240116.211441:0:14062:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008dc71fd5/0x8c5345f1c1ec6331 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 14717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240116.211451:0:14062:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008dc71fd5/0x8c5345f1c1ec6331 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 14717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240116.211472:0:14062:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782240116.211521:0:14062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f77f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+14:2345:x1868813738047232:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 200us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1782240116.211529:0:14062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 14 00000100:00100000:1.0:1782240116.211625:0:14718:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1782240116.211632:0:14718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738047360 00000100:00100000:1.0:1782240116.211635:0:14718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738047360 00000100:00100000:1.0:1782240116.211857:0:14718:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1782240116.211865:0:14718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738047104 00000100:00100000:1.0:1782240116.211867:0:14718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738047104 00000100:00100000:0.0:1782240116.212498:0:16206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 1 00000100:00100000:0.0:1782240116.212507:0:16206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb6018cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+15:2347:x1868813738046464:12345-192.168.203.32@tcp:4:dd.0 00010000:00010000:0.0:1782240116.212538:0:16206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009509df19/0x8c5345f1c1ec6338 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240116.212550:0:16206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782240116.212553:0:16206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782240116.212558:0:16206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009509df19/0x8c5345f1c1ec6338 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782240116.212569:0:16206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009509df19/0x8c5345f1c1ec6338 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240116.213973:0:14717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000a7c1c8c/0x8c5345f1c1ec6300 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.32@tcp remote: 0xc49095c69f28e9e0 expref: 15 pid: 14714 timeout: 595 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782240116.213994:0:14717:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f46fd880 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0000_UUID:14717:1868813759001600:192.168.203.32@tcp:104: 00010000:00010000:3.0:1782240116.214016:0:14717:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008dc71fd5/0x8c5345f1c1ec6331 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240116.214027:0:14717:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008dc71fd5/0x8c5345f1c1ec6331 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240116.214034:0:14717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008dc71fd5/0x8c5345f1c1ec6331 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782240116.318770:0:6614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00000001:00080000:0.0:1782240116.318792:0:6614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00002000:00010000:3.0:1782240116.319192:0:14717:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:3.0:1782240116.319197:0:14717:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1782240114 -> 1782240116 00002000:00010000:3.0:1782240116.319200:0:14717:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1782240114 -> 1782240116 00002000:00010000:3.0:1782240116.319203:0:14717:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:3.0:1782240116.319216:0:14717:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008dc71fd5/0x8c5345f1c1ec6331 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240116.319228:0:14717:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008dc71fd5/0x8c5345f1c1ec6331 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240116.319244:0:14717:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008dc71fd5/0x8c5345f1c1ec6331 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240116.319251:0:14717:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f7e27e00 already unused, calling callback (ffffffffc1728ce0) 00010000:00010000:3.0:1782240116.319256:0:14717:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008dc71fd5/0x8c5345f1c1ec6331 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240116.319264:0:14717:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008dc71fd5/0x8c5345f1c1ec6331 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240116.319284:0:14717:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008dc71fd5/0x8c5345f1c1ec6331 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240116.319293:0:14717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008dc71fd5/0x8c5345f1c1ec6331 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782240116.319384:0:14717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f77f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+15:2347:x1868813738046336:12345-192.168.203.32@tcp:4:dd.0 Request processed in 128728us (128934us total) trans 8589934598 rc 0/0 00000100:00100000:3.0:1782240116.319393:0:14717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 0 00000100:00100000:3.0:1782240116.319422:0:14717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 2 00000100:00100000:3.0:1782240116.319432:0:14717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb6018cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+14:2347:x1868813738046592:12345-192.168.203.32@tcp:4:dd.0 00010000:00010000:3.0:1782240116.319463:0:14717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f7140d5/0x8c5345f1c1ec633f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240116.319475:0:14717:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782240116.319486:0:14717:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782240116.319496:0:14717:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f7140d5/0x8c5345f1c1ec633f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240116.319510:0:14717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f7140d5/0x8c5345f1c1ec633f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782240116.362603:0:6614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00002000:00010000:1.0:1782240116.363522:0:16206:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 2097152 -> 3145728 00002000:00010000:1.0:1782240116.363529:0:16206:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 2051 -> 4103 00010000:00010000:1.0:1782240116.363545:0:16206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009509df19/0x8c5345f1c1ec6338 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240116.363557:0:16206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009509df19/0x8c5345f1c1ec6338 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240116.363565:0:16206:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009509df19/0x8c5345f1c1ec6338 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240116.363575:0:16206:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5c0030800 already unused, calling callback (ffffffffc1728ce0) 00010000:00010000:1.0:1782240116.363591:0:16206:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009509df19/0x8c5345f1c1ec6338 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240116.363601:0:16206:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009509df19/0x8c5345f1c1ec6338 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240116.363622:0:16206:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009509df19/0x8c5345f1c1ec6338 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240116.363632:0:16206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009509df19/0x8c5345f1c1ec6338 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782240116.363732:0:16206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb6018cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+14:2347:x1868813738046464:12345-192.168.203.32@tcp:4:dd.0 Request processed in 151221us (162499us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1782240116.363743:0:16206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 1 00000100:00100000:1.0:1782240116.363801:0:16206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 3 00000100:00100000:1.0:1782240116.363813:0:16206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb6018cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+13:2347:x1868813738046848:12345-192.168.203.32@tcp:4:dd.0 00010000:00010000:1.0:1782240116.363846:0:16206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e90035c2/0x8c5345f1c1ec6346 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240116.363857:0:16206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782240116.363861:0:16206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782240116.363867:0:16206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e90035c2/0x8c5345f1c1ec6346 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240116.363879:0:16206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e90035c2/0x8c5345f1c1ec6346 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782240116.395797:0:6614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00002000:00010000:3.0:1782240116.398023:0:14717:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 3145728 -> 5242880 00002000:00010000:3.0:1782240116.398034:0:14717:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 4103 -> 8199 00010000:00010000:3.0:1782240116.398051:0:14717:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f7140d5/0x8c5345f1c1ec633f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240116.398065:0:14717:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007f7140d5/0x8c5345f1c1ec633f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240116.398074:0:14717:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007f7140d5/0x8c5345f1c1ec633f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240116.398081:0:14717:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f7e26200 already unused, calling callback (ffffffffc1728ce0) 00010000:00010000:3.0:1782240116.398086:0:14717:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007f7140d5/0x8c5345f1c1ec633f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240116.398094:0:14717:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007f7140d5/0x8c5345f1c1ec633f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240116.398113:0:14717:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007f7140d5/0x8c5345f1c1ec633f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240116.398134:0:14717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f7140d5/0x8c5345f1c1ec633f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782240116.398228:0:14717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb6018cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+13:2347:x1868813738046592:12345-192.168.203.32@tcp:4:dd.0 Request processed in 78794us (196947us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1782240116.398237:0:14717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 2 00000100:00100000:3.0:1782240116.398269:0:14717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 4 00000100:00100000:3.0:1782240116.398280:0:14717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb6018cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+12:2347:x1868813738046720:12345-192.168.203.32@tcp:4:dd.0 00010000:00010000:3.0:1782240116.398308:0:14717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008dc71fd5/0x8c5345f1c1ec634d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240116.398319:0:14717:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782240116.398323:0:14717:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782240116.398329:0:14717:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008dc71fd5/0x8c5345f1c1ec634d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240116.398341:0:14717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008dc71fd5/0x8c5345f1c1ec634d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782240116.433850:0:6614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934601 is committed 00010000:00010000:3.0:1782240116.434483:0:16206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e90035c2/0x8c5345f1c1ec6346 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240116.434500:0:16206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e90035c2/0x8c5345f1c1ec6346 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240116.434527:0:16206:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e90035c2/0x8c5345f1c1ec6346 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240116.434535:0:16206:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f7e38400 already unused, calling callback (ffffffffc1728ce0) 00010000:00010000:3.0:1782240116.434549:0:16206:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e90035c2/0x8c5345f1c1ec6346 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240116.434558:0:16206:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e90035c2/0x8c5345f1c1ec6346 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240116.434577:0:16206:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e90035c2/0x8c5345f1c1ec6346 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240116.434585:0:16206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e90035c2/0x8c5345f1c1ec6346 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782240116.434675:0:16206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb6018cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+12:2347:x1868813738046848:12345-192.168.203.32@tcp:4:dd.0 Request processed in 70862us (233363us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1782240116.434685:0:16206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 3 00000100:00100000:3.0:1782240116.434715:0:16206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 5 00000100:00100000:3.0:1782240116.434726:0:16206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb6018cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+11:2347:x1868813738046976:12345-192.168.203.32@tcp:4:dd.0 00010000:00010000:3.0:1782240116.434794:0:16206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f7140d5/0x8c5345f1c1ec6354 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240116.434808:0:16206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782240116.434818:0:16206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782240116.434824:0:16206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f7140d5/0x8c5345f1c1ec6354 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240116.434836:0:16206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f7140d5/0x8c5345f1c1ec6354 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782240116.501347:0:6614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934602 is committed 00002000:00010000:3.0:1782240116.501452:0:14717:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 5242880 -> 6291456 00002000:00010000:3.0:1782240116.501457:0:14717:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 10247 00010000:00010000:3.0:1782240116.501472:0:14717:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008dc71fd5/0x8c5345f1c1ec634d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240116.501484:0:14717:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008dc71fd5/0x8c5345f1c1ec634d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240116.501492:0:14717:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008dc71fd5/0x8c5345f1c1ec634d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240116.501499:0:14717:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f7e27e00 already unused, calling callback (ffffffffc1728ce0) 00010000:00010000:3.0:1782240116.501504:0:14717:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008dc71fd5/0x8c5345f1c1ec634d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240116.501513:0:14717:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008dc71fd5/0x8c5345f1c1ec634d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240116.501534:0:14717:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008dc71fd5/0x8c5345f1c1ec634d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240116.501559:0:14717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008dc71fd5/0x8c5345f1c1ec634d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782240116.501712:0:14717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb6018cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+11:2347:x1868813738046720:12345-192.168.203.32@tcp:4:dd.0 Request processed in 103430us (300387us total) trans 8589934602 rc 0/0 00000100:00100000:3.0:1782240116.501819:0:14717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 4 00000100:00100000:3.0:1782240116.501852:0:14717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 6 00000100:00100000:3.0:1782240116.501865:0:14717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f77f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+10:2346:x1868813738047360:12345-192.168.203.32@tcp:4:dd.0 00010000:00010000:3.0:1782240116.501896:0:14717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c33ad8c9/0x8c5345f1c1ec635b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240116.501921:0:14717:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782240116.501979:0:14717:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782240116.501986:0:14717:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c33ad8c9/0x8c5345f1c1ec635b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240116.501999:0:14717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c33ad8c9/0x8c5345f1c1ec635b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782240116.575783:0:6614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934603 is committed 00002000:00010000:2.0:1782240116.578164:0:16206:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7654321 00002000:00010000:2.0:1782240116.578184:0:16206:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 10247 -> 14343 00010000:00010000:2.0:1782240116.578201:0:16206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f7140d5/0x8c5345f1c1ec6354 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240116.578213:0:16206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007f7140d5/0x8c5345f1c1ec6354 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240116.578222:0:16206:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007f7140d5/0x8c5345f1c1ec6354 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240116.578230:0:16206:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f7e26200 already unused, calling callback (ffffffffc1728ce0) 00010000:00010000:2.0:1782240116.578235:0:16206:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007f7140d5/0x8c5345f1c1ec6354 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240116.578258:0:16206:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007f7140d5/0x8c5345f1c1ec6354 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240116.578278:0:16206:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007f7140d5/0x8c5345f1c1ec6354 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240116.578287:0:16206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f7140d5/0x8c5345f1c1ec6354 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782240116.578385:0:16206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb6018cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+10:2347:x1868813738046976:12345-192.168.203.32@tcp:4:dd.0 Request processed in 143656us (377045us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1782240116.578400:0:16206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 5 00000100:00100000:2.0:1782240116.578584:0:16206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 7 00000100:00100000:2.0:1782240116.578596:0:16206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f77f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+9:2346:x1868813738047104:12345-192.168.203.32@tcp:4:dd.0 00010000:00010000:2.0:1782240116.578627:0:16206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b225e67/0x8c5345f1c1ec6362 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240116.578640:0:16206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782240116.578644:0:16206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782240116.578650:0:16206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004b225e67/0x8c5345f1c1ec6362 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782240116.578663:0:16206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004b225e67/0x8c5345f1c1ec6362 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782240116.624185:0:6614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934604 is committed 00010000:00010000:3.0:1782240116.624689:0:14717:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c33ad8c9/0x8c5345f1c1ec635b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240116.624706:0:14717:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c33ad8c9/0x8c5345f1c1ec635b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240116.624731:0:14717:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c33ad8c9/0x8c5345f1c1ec635b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240116.624739:0:14717:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb5f7e27000 already unused, calling callback (ffffffffc1728ce0) 00010000:00010000:3.0:1782240116.624744:0:14717:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c33ad8c9/0x8c5345f1c1ec635b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240116.624774:0:14717:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c33ad8c9/0x8c5345f1c1ec635b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240116.624794:0:14717:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c33ad8c9/0x8c5345f1c1ec635b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782240116.624801:0:14717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c33ad8c9/0x8c5345f1c1ec635b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782240116.624885:0:14717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f77f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+9:2346:x1868813738047360:12345-192.168.203.32@tcp:4:dd.0 Request processed in 123020us (413787us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1782240116.624895:0:14717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 6 00000001:00080000:3.0:1782240116.659554:0:6614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934605 is committed 00002000:00010000:1.0:1782240116.659659:0:16206:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:1.0:1782240116.659677:0:16206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b225e67/0x8c5345f1c1ec6362 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240116.659689:0:16206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004b225e67/0x8c5345f1c1ec6362 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240116.659697:0:16206:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004b225e67/0x8c5345f1c1ec6362 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240116.659704:0:16206:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb4c2018e00 already unused, calling callback (ffffffffc1728ce0) 00010000:00010000:1.0:1782240116.659709:0:16206:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004b225e67/0x8c5345f1c1ec6362 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240116.659718:0:16206:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004b225e67/0x8c5345f1c1ec6362 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240116.659737:0:16206:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004b225e67/0x8c5345f1c1ec6362 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782240116.659744:0:16206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004b225e67/0x8c5345f1c1ec6362 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782240116.659930:0:16206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f77f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+5:2346:x1868813738047104:12345-192.168.203.32@tcp:4:dd.0 Request processed in 81324us (448778us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1782240116.659940:0:16206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 7 00010000:00010000:1.0:1782240117.217733:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782240117.537435:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782240117.537456:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f46fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1868813759001728:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782240117.537535:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782240117.537609:0:14716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813759001728 00000100:00100000:3.0:1782240117.537617:0:14716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813759001728 00000100:00100000:3.0:1782240117.537682:0:14716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1782240117.537691:0:14716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f46fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1868813759001728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782240117.537724:0:14716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782240117.537803:0:14716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f46fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1868813759001728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1782240117.537811:0:14716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1782240117.537831:0:14072:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782240117.537872:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f46fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1868813759001728:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782240117.538242:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f77f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:3306:1868813759001856:0@lo:400:kworker.0 00000100:00100000:1.0:1782240117.538278:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782240117.538313:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fc08d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1868813759002368:0@lo:400:kworker.0 00000100:00100000:1.0:1782240117.538340:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782240117.538359:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782240117.538365:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5f77f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813759001984:0@lo:400:kworker.0 00000100:00100000:1.0:1782240117.538387:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782240117.538414:0:15850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813759002368 00000100:00100000:1.0:1782240117.538418:0:15850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813759002368 00000100:00100000:1.0:1782240117.538455:0:15850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1782240117.538464:0:15850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc08e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1868813759002368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782240117.538515:0:15850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc08e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1868813759002368:12345-0@lo:400:kworker.0 Request processed in 53us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1782240117.538522:0:15850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1782240117.538555:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fc08d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1868813759002368:0@lo:400:kworker.0 00000100:00100000:0.0:1782240117.540252:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fc08f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1868813759002240:0@lo:400:kworker.0 00000100:00100000:0.0:1782240117.540314:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782240117.540365:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782240117.540387:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9bb5fc08ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1868813759002112:0@lo:400:kworker.0 00000100:00100000:0.0:1782240117.540412:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782240117.540446:0:14077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813759002240 00000100:00100000:0.0:1782240117.540451:0:14077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813759002240 00000100:00100000:0.0:1782240117.541106:0:14077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813759002112 00000100:00100000:0.0:1782240117.541111:0:14077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813759002112 00000100:00100000:0.0:1782240117.541137:0:14077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1782240117.541144:0:14077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7811180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1868813759002240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782240117.541202:0:14077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7811180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1868813759002240:12345-0@lo:400:kworker.0 Request processed in 57us (887us total) trans 0 rc 0/0 00000100:00100000:0.0:1782240117.541209:0:14077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1782240117.541225:0:14077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1782240117.541231:0:14077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f7812d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1868813759002112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782240117.541260:0:14077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f7812d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1868813759002112:12345-0@lo:400:kworker.0 Request processed in 29us (847us total) trans 0 rc 0/0 00000100:00100000:0.0:1782240117.541266:0:14077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1782240117.541323:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fc08ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1868813759002112:0@lo:400:kworker.0 00000100:00100000:0.0:1782240117.541334:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5fc08f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1868813759002240:0@lo:400:kworker.0 00000100:00100000:3.0:1782240117.541518:0:14068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813759001856 00000100:00100000:3.0:1782240117.541524:0:14068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813759001856 00000100:00100000:3.0:1782240117.541557:0:14068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1782240117.541564:0:14068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ee01b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+19:3306:x1868813759001856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782240117.541619:0:14068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ee01b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8bfa1ba2-9083-4509-bfe8-a04280fb1c10+19:3306:x1868813759001856:12345-0@lo:400:kworker.0 Request processed in 55us (3339us total) trans 0 rc 0/0 00000100:00100000:3.0:1782240117.541625:0:14068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1782240117.541654:0:14712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813759001984 00000100:00100000:3.0:1782240117.541657:0:14712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813759001984 00000100:00100000:3.0:1782240117.541686:0:14712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1782240117.541692:0:14712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5fc08f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1868813759001984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782240117.541724:0:14712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5fc08f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1868813759001984:12345-0@lo:400:kworker.0 Request processed in 32us (3336us total) trans 0 rc 0/0 00000100:00100000:3.0:1782240117.541730:0:14712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1782240117.541778:0:14072:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782240117.541784:0:14072:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782240117.541805:0:3306:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:3.0:1782240117.541810:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bb6018ce680, transno 8589934595 00000004:00080000:3.0:1782240117.541820:0:3306:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:3.0:1782240117.541849:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f77f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1868813759001984:0@lo:400:kworker.0 00000100:00100000:3.0:1782240117.541862:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9bb5f77f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8bfa1ba2-9083-4509-bfe8-a04280fb1c10:3306:1868813759001856:0@lo:400:kworker.0 00010000:00010000:1.0:1782240118.249356:0:14064:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1782240118.268346:0:16245:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:1.0:1782240119.263446:0:14065:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782240119.328693:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782240119.328740:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782240119.328796:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782240119.328820:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782240119.328838:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782240119.328853:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782240119.328870:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1782240119.328907:0:14714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738047872 00000100:00100000:3.0:1782240119.328916:0:14714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738047872 00000100:00100000:3.0:1782240119.328963:0:14714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738047744 00000100:00100000:3.0:1782240119.328966:0:14714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738047744 00000100:00100000:3.0:1782240119.328976:0:14714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738048128 00000100:00100000:3.0:1782240119.328978:0:14714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738048128 00000100:00100000:3.0:1782240119.328995:0:14714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738048256 00000100:00100000:3.0:1782240119.328997:0:14714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738048256 00000100:00100000:3.0:1782240119.329011:0:14714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 16 00000100:00100000:3.0:1782240119.329018:0:14714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f46ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+5:2345:x1868813738047872:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:3.0:1782240119.329078:0:14714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f46ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+5:2345:x1868813738047872:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 60us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1782240119.329085:0:14714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 16 00000100:00100000:3.0:1782240119.329099:0:14714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 17 00000100:00100000:3.0:1782240119.329105:0:14714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f46ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+5:2344:x1868813738047744:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:3.0:1782240119.329123:0:14714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f46ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+5:2344:x1868813738047744:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 19us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1782240119.329142:0:14714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 17 00000100:00100000:3.0:1782240119.329151:0:14714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 18 00000100:00100000:3.0:1782240119.329162:0:14714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f46fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e915549f-7383-4873-bb08-ab4dbf0961dd+5:2345:x1868813738048128:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:3.0:1782240119.329181:0:14714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f46fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e915549f-7383-4873-bb08-ab4dbf0961dd+5:2345:x1868813738048128:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 25us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1782240119.329186:0:14714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 18 00000100:00100000:3.0:1782240119.329194:0:14714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 19 00000100:00100000:3.0:1782240119.329199:0:14714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f46fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e915549f-7383-4873-bb08-ab4dbf0961dd+5:2344:x1868813738048256:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:3.0:1782240119.329215:0:14714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f46fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e915549f-7383-4873-bb08-ab4dbf0961dd+5:2344:x1868813738048256:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 16us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1782240119.329220:0:14714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 19 00000100:00100000:3.0:1782240119.329237:0:14078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738047616 00000100:00100000:3.0:1782240119.329240:0:14078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738047616 00000100:00100000:3.0:1782240119.329262:0:14078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738048000 00000100:00100000:3.0:1782240119.329264:0:14078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738048000 00000100:00100000:3.0:1782240119.329281:0:14078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 29 00000100:00100000:3.0:1782240119.329286:0:14078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f46fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+20:2345:x1868813738047616:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:3.0:1782240119.329310:0:14078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f46fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f37709f9-b2ea-4b23-a6ac-c11fd00efb2a+20:2345:x1868813738047616:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 24us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1782240119.329316:0:14078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 29 00000100:00100000:3.0:1782240119.329325:0:14078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 30 00000100:00100000:3.0:1782240119.329331:0:14078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5f46fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e915549f-7383-4873-bb08-ab4dbf0961dd+6:2344:x1868813738048000:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:3.0:1782240119.329353:0:14078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5f46fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e915549f-7383-4873-bb08-ab4dbf0961dd+6:2344:x1868813738048000:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 22us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1782240119.329365:0:14078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 30 00000100:00080000:3.0:1782240119.329384:0:14072:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782240119.329388:0:14072:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782240119.329390:0:14072:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782240119.330237:0:14070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868813738047488 00000100:00100000:1.0:1782240119.330245:0:14070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868813738047488 00000100:00100000:1.0:1782240119.330286:0:14070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 124 00000100:00100000:1.0:1782240119.330293:0:14070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb5ee01b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94a0379e-2f28-4d53-90a1-f8718289b741+13:2344:x1868813738047488:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:1.0:1782240119.330348:0:14070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb5ee01b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94a0379e-2f28-4d53-90a1-f8718289b741+13:2344:x1868813738047488:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 54us (1663us total) trans 0 rc 0/0 00000100:00100000:1.0:1782240119.330355:0:14070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 124 Debug log: 29727 lines, 29727 kept, 0 dropped, 0 bad.